Lectures on 
Diffusion Problems and Partial Differential 
Equations 



By 

S. R. S. Varadhan 



Notes by 
Pl. Muthuramalingam 
Tara R. Nanda 



Tata Institute of Fundamental Research, Bombay 

1989 



Author 

S. R. S. Varadhan 

Courant Institute of Mathematical Sciences 
251, Mercer Street 
New York. N. Y. 10012. 
U.S.A. 



© Tata Institute of Fundamental Research, 1989 



ISBN 3-540-08773-7. Springer- Verlag, Berlin, Heidelberg. New York 
ISBN 0-387-08773-7. Springer- Verlag, New York. Heidelberg. Berlin 



No part of this book may be reproduced in any 
form by print, microfilm or any other means with- 
out written permission from the Tata Institute of 
Fundamental Research, Bombay 400 005 



Printed by N. S. Ray at the Book Centre Limited 
Sion East, Bombay 400 022 and published by H. Goetze 
Springer- Vertal, Heidelberg, West Germany 

PRINTED IN INDIA 



Contents 



1 The Heat Equation! 

2 Kolmogorov's Theorem! 



3 


The One Dimensional Random Walk! 




4 


Construction of Wiener Measure! 




5 


Generalised Brownian Motion! 




6 


Markov ProDerties of Brownian Motion! 



7 Reflection Principle! 



8 Blumenthal's Zero-One Law 



9 Properties of Brownian Motion in One Dimension! 

10 Dirichlet Problem and Brownian Motion! 

11 Stochastic Integration! 

12 Change of Variable Formula! 

13 Extension to Vector- Valued ltd Processes! 



14 Brownian Motion as a Gaussian Process! 



iii 



iv 



15 Equivalent For of ltd Processl 



16 Ito's Formula! 



17 Solution of Poisson's Equations! 



18 The Fevnman-Kac Formula! 



19 An Application of the Fevnman-Kac Formula...] 



20 Brownian Motion with Drift 



21 Integral Equations! 



22 Large Deviations! 



23 Stochastic Integral for a Wider Class of Functions! 



24 Explosions! 



25 Construction of a Diffusion Processl 



26 Uniqueness of Diffusion Processl 



27 On Lipschitz Square Roots! 



28 Random Time Changes! 



29 Cameron - Martin - Girsanov Formula! 



30 Behaviour of Diffusions for Large Times! 



31 Invariant Probability Distributions! 



32 Ergodic Theoren] 



33 Application of Stochastic Integral 



Appendix! 



Contents 



Language of Probability 



Kolmogorovs Theorem! 



Martingales! 



Uniform Integrabilitv 



Up Crossings and Down Crossings! 



Bibliography 



vi 



Contents 



Preface 



THESE ARE NOTES based on the lectures given at the T.I.F.R. 
Centre, Indian Institute of Science, Bangalore, during July and August 
of 1977. Starting from Brownian Motion, the lectures quickly got into 
the areas of Stochastic Differential Equations and Diffusion Theory. An 
attempt was made to introduce to the students diverse aspects of the 
theory. The last section on Martingales is based on some additional 
lectures given by K. Ramamurthy of the Indian Institute of Science. The 
author would like to express his appreciation of the efforts by Tara R. 
Nanda and PL. Muthuramalingam whose dedication and perseverance 
has made these notes possible. 



S.R.S. Varadhan 



1. The Heat Equation 



LET US CONSIDER the equation 1 
(1) u t - ^Au = 

which describes (in a suitable system of units) the temperature distribu- 
tion of a certain homogeneous, isotropic body in the absence of any heat 
sources within the body. Here 



u - u(xi, . . . ,Xd, t); u t - 




t represents the time ranging over [0, oo) or [0, T] and x = (xi . . . Xd) 
belongs to Mf 1 . 

We first consider the initial value problem. It consists in integrating 
equation (Q subject to the initial condition 

(2) «(0, *) = /(*). 

The relation © is to be understood in the sense that 

Lt u(t, x) = f(x). 

f->0 

Physically (0 means that the distribution of temperature throughout 
the body is known at the initial moment of time. 

We assume that the solution u has continuous derivatives, in the 
space coordinates upto second order inclusive and first order derivative 
in time. 
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1. The Heat Equation 



It is easily verified that 

(3) u{ux) = (2^ exp (~i7) ; w2= Z a '?' 

2 satisfies Q and 

(4) h(0, x) = Lt w(f, je) = 5(jc) 

f->0 

Equation © gives us a very nice physical interpretation. The so- 
lution © can be interpreted as the temperature distribution within the 
body due to a unit sourse of head specified at t — at the space point 
x = 0. The linearity of the equation Q now tells us that (by superpo- 
sition) the solution of the initial value problem may be expected in the 
form 



(5) u(t, x) = f(y)p(t, x - y)dy, 



where 

1 \x\ 2 

Exercise 1. Let f(x) be any bounded continuous function. Verify that 
p(t, x) satisfies Q and show that 



(a) J p(t, x)dx = 1, Vt > 0; 

(b) Lt jp(t,x)f(x)dx = f(0); 

(c) using (b) justify ©. Also show that © solves the initial value 
problem. 

(Hints: For (a) use J e'^dx - -\[n. For part (b) make the substitution 

— DO 

X 

y = — — and apply Lebesgue dominated convergence theorem). 
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Since equation Q is linear with constant coefficients it is invariant 
under time as well as space translations. This means that translates of 
3 solutions are also solutions. Further, for s > 0, t > and y e R d , 

1 \x-y\ 2 

(6) U(t, x) = rrr exp 

and for t > s, y e R rf , 

1 |x-y| 2 
[2n(t - s)Y' lz 2{t - s) 

are also solutions of the heat equation Q. 

The above method of solving the initial value problem is a sort of 
trial method, viz. we pick out a solution and verify that it satisfies Q. 
But one may ask, how does one obtain the solution? A partial clue to this 
is provided by the method of Fourier transforms. We pretend as if our 
solution u(t, x) is going to be very well behaved and allow all operations 
performed on u to be legitimate. 

Put v(t, x) - u(t, x) where "^stands for the Fourier transform in the 
space variables only (in this case), i.e. 



v{t,x) = J u{t,y)e ix y . 



dy. 



Using equation Q, one easily verifies that 

(8) v t {t,x) = ^\x\ 2 v{t,x) 
with 

(9) v(0, *)=/(*). 
The solution of equation © is given by 

(10) v(t,x)=f\x)e- tM2/2 . 



We have used © in obtaining ( flQl ). 
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1. The Heat Equation 



p(t, x) = exp - — - . 



Exercise 2. Verify that 



2 

Using Exercise EJ (fTUt can be written as 
(11) v(f,x) = fi(f,jc) = f(x)p(t,x). 

The right hand side above is the product of two Fourier transforms 
and we know that the Fourier transform of the convolution of two fun- 
tions is given by the product of the Fourier transforms. Hence u(t, x) is 
expected to be of the form ©. 

Observe that if / is non-negative, then u is nonnegative and if / 
is bounded by M then u is also bounded by M in view of part (a) of 
Exercise ffl 

The Inhomogeneous Equation. Consider the equation 
Av 

v t - — = g, with v(0, x) = 0, 

which describes the temperature within a homogeneous isotropic body 
in the presence of heat sources, specified as a function of time and space 
by g(t, x). For t > s, 

u(t, x) = — exp - 

[2n(t-s)] d ' 2 F 2(t-s) 

is a solution of u t (t, x) - -Au(t, x) - corresponding to a unit source at 
t — s, x — y. Consequently, a solution of the inhomogeneous problem is 
obtained by superposition. 
Let 

v(t,x)= f f s(s,y) Trrexpf-I^ — —\dyds 

J J S ,y '{27t{t-s)YI 2 \ 2(t-s)} y 

R d 
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i.e. 



5 



v(t, x) — r w(t, x, s)ds 



where 



f l I U-y\ 2 \ 

W {t,x,s) = j sis,y) {2n{us)YI2 „p -— rfy. 



Exercise 3. Show that v(?, x) defined above solves the inhomogeneous 
heat equation and satisfies v(0, x) = 0. Assume that g is sufficiently 

smooth and has compact support. v t - -Av = Lt w(t, x, s) and now use 

2 .v— >? 

part (b) of Exercise ([IJ. 

Remark 1. We can assume g has compact support because in evaluating 
v, - -Av the contribution to the integral is mainly from a small neigh- 
bourhood of the point (t, x). Outside this neighbourhood 

1 . / |Jc-;y| 



[2n{t - s)] d V CXP \ lit - s) 
satisfies 

lit - -Au = 0. 
2 

2. If we put g(s, y) - for s < 0, we recognize that v(t, x) - g * p. 
Taking spatial Fourier transforms this can be written as 



V (,t,o = ^ g{s,o^v-\{t-sm 2 d^ 



or 

Therefore 

dv 1 

Av = g. 

dt 2 S 
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1. The Heat Equation 



1 



Exercise 4. Solve w, - -Aw = g on [0, oo) x R d with w - f on {0} x R d 6 
(Cauchy problem for the heat equation). 

Uniqueness. The solution of the Cauchy problem is unique provided the 
class of solutions is suitably restricted. The uniqueness of the solution 
is a consequence of the Maximum Principle. 

Maximum Principle. Let u be smooth and bounded on [0, T] X R d sat- 
isfying 

u t -^->0 in (0, T] x R d and u(0, x) > 0, Vx e R d . 



Proof. The idea is to find minima for u or for an auxiliary function. 
Step 1. Let v be any function satisfying 



Claim . v cannot attain a minimum for to e (0, T]. Assume (to get a 
contradiction) that v(?o,xo) < v(t, x) for some to > and for all t e 
[0, T], Vx € R d . At a minimum v t (to, xq) < 0, (since to + 0) Av(?o, xo) > 
0. Therefore 



Then 



u(t, x) > V, te [0, T] and Vx e R d . 



v t - — >0 in (0, T] x R d . 




Thus, if v has any minimum it should occur at to - 0. 



Step 2. Let e > be arbitrary. Choose a such that 



h(t, x) = |x| 2 + at 
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satisfies 




a - d > (say a = 2d). 



7 



Put v e = u + eh. Then 



_--Av t >0. 

As u is bounded, v e —> +00 as |jc| — > +00, v e must attain a minimum. 
This minimum occurs at t = by Step 1. Therefore, 

v £ (t, x) > v e (0, xq) for some xq e R d , 



i.e. 



v e (f, x) > m(0, xq) + e\xo\ 2 > 0, 



i.e. 

u(t, x) + eh(t, x) > 0, Ve. 

This gives 

u(t, x) > 0. 

This completes the proof. □ 

Exercise 5. (a) Let L be a linear differential operator satisfying Lu = 
gonO (open in E. d ) and u - f on dQ.. Show that m is uniquely 
determined by / and g if and only if Lu - on O and u = on 
<3Q imply m = on fl 

(b) Let u be a bounded solution of the heat equation u t — -Am = g 
with w(0, x) = /(jc). Use the maximum principle and part (a) to 
show that u is unique in the class of all bounded functions. 

(c) Let 

\e~^\ if f > 0, 
0, if f < 0, 



g(t) = 
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1. The Heat Equation 



Then 

Au 

w(0, x) - 0, u t - — , H J 0, 

i.e. w satisfies 

1 <9 2 m 

M ? ~ - °> witn x ) - °- 

2 dx z 

This example shows that the solution is not unique because, u is 
not bounded. (This example is due to Tychonoff). 

1 \x\ 2 

Lemma 1. Let p(t, x) = — 2 exp — — for t > 0. Then 

p(t, •) * p(s, •) = pit + s, •). 
Proof. Let / be any bounded continuous function and put 

u(t, x) = J f(y)p(t, x - y)dy. 

Then u satisfies 

u t - - Au = 0, u{0, x) - f{x). 



Let 
Then 



v(f, x) - uit + s,x). 



v t - -Av = 0, v(0, x) = uis, x). 



This has the unique solution 

vit, x) = ^ uis, y)pit, x - y)dy. 

Thus 

J f(y)p(t + s,x- y)dy = JJ fiz)pis, y - z)pit, x - y)dz dy. 
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This is true for all / bounded and continuous. We conclude, there- 
fore, that 

p(t, •) * p(s, •) = p(t + s, •). 

□ 

Exercise 6. Prove Lemmaffl directly using Fourier transforms. 

It will be convenient to make a small change in notation which will 
be useful later on. We shall write p(s, x, t, y) - p(t- s,y—x) for every x, y 
and t > s. p(s, x, t, y) is called the transition probability, in dealing with 
Brownian motion. It represents the probability density that a "Brownian 
particle" located at space point x at time s moves to the space point y at 
a later time t. 

Note . We use the same symbol p for the transition probability; it is 
function of four variables and there will not be any ambiguity in using 
the same symbol p. 

Exercise 7. Verify that 

J p(s, x, t, y)p(t, y, cr, z)dy = p(s, x, cr,z), s < t < a. 

w' 

(Use Exercise^. 

Remark . The significance of this result is obvious. The probability 
that the particle goes from x at time s to z at time cr is the sum total 
of the probabilities, that the particle moves from x at s to y at some 
intermediate time t and then to z at time cr. 
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1. The Heat Equation 
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In this section we have introduced Brownian Motion corresponding 
to the operator - A. Later on we shall introduce a more general diffusion 

process which corresponds to the operator ^ £ an—^— — + 2 ^/tt~- 

2 oxidxj oxj 



2. Kolmogorov's Theorem 



Definition. LET (O, P) BE A probability space. A stochastic process 11 
in M. d is a collection {X, : t e 1} of R^-valued random variables defined 
on (Q, SS). 

Note 1. 1 will always denote a subset of R + = [0, oo). 
2. X, is also denoted by X(t). 

Let {X t : t e 1} be a stochastic process. For any collection t\, 
t2,...,tk such that ti e I and < t\ < t2 < ... < h and any Borel 
set A, in R d x R d x • • • x R d (k times),, define 

F h . . . t k (A) = P(w e Q : (X„ (w), X tk {w)) e A). 

If 

{ti,...,t k }<z{si,...,st\<zl, with />£ 

such that 

sf < ... < ^ < h < s f...< 4" < fa ... < ft < ,f ... < e 

let then 

w : R d x • • • x R d (\ times) R d x • • • x R d (k times) 

be the canonical projection. If E tj c R d is any Borel set in R d , i = 
1 , 2, . . . , k, then 

/T 1 ^ x • • • x E tk ) = R d x • • • x E h x R d x • • • x E t2 x • • • x R d 
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2. Kolmogorov's Theorem 



(I times). The following condition always holds. 

(*) E h ... t k (E tx x • • • x E tk ) = F S1 . . . s l (U~ 1 (E n x • • • x E tk )). 

If (*) holds for an arbitrary collection {F t[ , . . tk '• < t\ < ti . . . < tk} 12 
(k = 1, 2, 3 . . .) of distributions then it is said to satisfy the consistency 
condition. 

Exercise 1. (a) Verify that F tl ... tk is a probability measure on R x 
• • • x R d (k times). 

(b) Verify (*). (If B,„ denotes the Borel a field of W\ B m+n = B m x 

B n ). 

The following theorem is a converse of Exercise ffl and is often used 
to identify a stochastic process with a family of distributions satisfying 
the consistency condition. 

Kolmogorov's Theorem. 

Let {F tl j 2 ^ tk < t\ < ?2 < ■ ■ ■ < h < oo) be a family of probability 
distributions (on M. d X • • • X R rf , k times, k = 1,2, . . .) satisfying the 
consistency condition. Then there exists a measurable space (Qj.,B), 
a unique probability measure P an (Q.^, $$~) and a stochastic process 
{X t : < t < oo) such that the family of probability measures associated 
with it is precisely 

{F h , h ,...t k : < h < t 2 < . . . < t k < oo\, k- 1,2, 

A proof can be found in the APPENDIX. We mention a few points 
about the proof which prove to be very useful and should be observed 
carefully. 

13 1. The space Q.^ is the set of all R^-valued functions defined on 

[0, oo): 

fe[0,oo) 

2. The random variable X t is the ? th -projection of Q.k onto Rf. 
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3. is the smallest cr-algebra with respect to which all the projec- 
tions are measurable. 

4. P given by 

P(w : X h (w) € A u . ..X tk (w) € A k ) - F h .., k (A x x • • • x A k ) 

where A,- is a Borel set in M. d , is a measure on the algebra generated 
by {X tl ,...X tk }(k= 1, 2, 3 . . .) and extends uniquely to 

Remark . Although the proof of Kolmogorov's theorem is very con- 
structive the space Q.k is too "large" and the cr-algebra 33 too "small" 
for practical purposes. In applications one needs a "nice" collection 
of Revalued functions (for example continuous, or differentiable func- 
tions), a "large" cr-algebra on this collection and a probability measure 
concentrated on this family. 



3. The One Dimensional 
Random Walk 



BEFORE WE TAKE up Brownian motion, we describe a one dimen- 14 
sional random walk which in a certain limiting case possesses the prop- 
erties of Brownian motion. 

Imagine a person at the position x - at time t - 0. Assume that at 
equal intervals of time t - r he takes a step h either along the positive 
x axis or the negative x axis and reaches the point x(t) = x(t - t) + h or 
x(t) - x(t - t) - h respectively. The probability that he takes a step in 
either direction is assumed to be 1/2. Denote by f(x, t) the probability 
that after the time t - nr (n intervals of time r) he reaches the position x. 
If he takes m steps to the right (positive ^-axis) in reaching x then there 
are n C m possible ways in which he can achieve these m steps. Therefore, 

the probability f(x, t) is n C m (jf. 

f(x, t) satisfies the difference equation 

(1) fix, t + T) = jf(x -h,t) + jf(x + h, t) 
and 

(2) x = h(m - (n - m)) = (2m - n)h. 

To see this one need only observe that to reach (x, t + t) there are 
two ways possible, viz. (x -h,t) — > (x, t + t) or (x + h, t) — > (x,t + t) and 
the probability for each one of these is 1/2. Also note that by definition 



15 



16 



3. The One Dimensional Random Walk 



off, 

(3) /(A,T) = i=/H»,T), 
so that 

(4) f(x, t + T)= f(h, T)f(x -h,t)+ f(-h, T)f( X + h, t). 

The reader can identify © as a "discrete version" of convolution. 
By our assumption, 

(5) /(0,0) = 1, /0c0) = if x*0. 

We examine equation Q in the limit h — > 0, t — > 0. To obtain 
reasonable results we cannot let h and r tend to zero arbitratily. Instead 
we assume that 

h 

(6) > 1 as h — > and t — > 0. 

T 

The physical nature of the problem suggests that © should hold. To 
see this we argue as follows. Since the person is equally likely to go in 
either direction the average value of x will be 0. Therefore a reasonable 
measure of the "progress" made by the person is either \x\ or x 2 . Indeed, 
since x is a random variable (since m is one) one gets, using 

E(x) - 2E(m) -n = 0, E(x 2 ) - h 2 E({2m - n) 2 ) - h 2 n. 
(Use S m»C m - = -, 2 »C m - - "4"^) 

m=0 \^/ ^ m=0 W 4 

Thus 

x 2 l 1 , h 2 n h 2 



[ t ) t TIT T 

and as t becomes large we expect that the average distance covered per 
unit time remains constant. (This constant is chosen to be 1 for reasons 
that will become apparent later). This justifies In fact, a simple 
h 2 

argument shows that if > or +oo, x may approach +oo in a finite 

r 

time which is physically untenable. 
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(1) now gives 

/(*, t + T)- f{x, t) = -{fix -h,t)- fix, t) + fix, h, t) - fix, t)}. 

Assuming sufficient smoothness on /, we get in the limit as h, t — > 
and in view of 

m d J- = -^l 

{ ' dt 2 dx 2 

h 2 

(to get the factor 1 /2 we choose > 1). This is the equation satisfied 

T 

by the probability density /. The particle in this limit performs what is 
known as Brownian motion to which we now turn our attention. 



References. 

[1] GNEDENKO: The theory of probability, Ch. 10. 
[2] The Feynman Lectures on physics, Vol. 1, Ch. 6. 



4. Construction of Wiener 
Measure 



ONE EXAMPLE WHERE the Kolmogorov construction yields a proba- 17 
bility measure concentrated on a "nice" class Q is the Brownian motion. 

Definition . A Brownian motion with starting point x is an Revalued 
stochastic process [X(t) : < t < oo} where 

(i) X(0) - x - constant; 

(ii) the family of distribution is specified by 

F h ... t k (A) - J p(0, x, t\ , xi)p(h ,xuti,x 2 )... 

A 

p(tk-i, *k-i, tk, Xk)dxi ...dx k 

for every Borel set A in M. d x • • • M. d (k times). 

N.B. The stochastic process appearing in the definition above is the one 
given by the Kolmogorov construction. 

It may be useful to have the following picture of a Brownian motion. 
The space £l k may be thought of as representing particles performing 
Brownian movement; {X t : < t < oo} then represents the trajectories 
of these particles in the space W 1 as functions of time and SB can be con- 
sidered as a representation of the observations made on these particles. 

Exercise 2. (a) Show that F h _ tk defined above is a probability mea- 
sure on W 1 x • • • x W 1 {k times). 
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4. Construction of Wiener Measure 



(b) [F tl ...t k '■ < t\ < t2 < . . .tk < oo} satisfies the consistency 
condition. (Use Fubini's theorem). 

(c) X h -x,X t2 -X h ,..., X tk - X tkl are independent random variables 
and if t > s, then X t - X s is a random variable whose distribution 
density is given by 

*- s ' y)= w -^ exp B (? -^ i|y|2 )- 

(Hint: Try to show that X ti - x, X t2 - X tl , . . . , X tk - X tkl have a 
joint distribution given by a product measure. For this let <f> be 
any bounded real measurable function on R d x • • • x R d (k times). 
Then 

E((P(Z u ...,Z k )) = E (0(Zi Zjt-Zfc-i)) 
x t{ -x,x, 2 -x ti ,...,x, k -x tkl ^f<] ,---,x, k 

where E((f>) is the expectation of <f> with respect to the joint dis- 

x H ...x, k 

tribution of (X tl ...,X tk ). You may also require the change of vari- 
able formula). 

Problem . Given a Brownian motion with starting point x our aim is to 
find a probability P x on the space Q. - C([0, oo); R d ) of all continuous 
funcitons from [0, oo) — » M. d which induces the Brownian motion. We 
will thus have a continuous realisation to Brownian motion. To achieve 
this goal we will work with the collection {F, U ^ A : < t\ < ?2 < ■ ■ ■ < 
tk) where tj € D, a countable dense subset of [0, oo). 

Step 1. The first step is to find a probability measure on a "smaller" 
space and lift it to C([0, oo); R d ). Let 

Q = C([0,oo);R rf ), 

D a countable dense subset of [0, oo); Q(D) = {F : D — > R d ] where / 

is uniformly continuous on [0, N] n D for Af = 1,2, We equip Q. 

with the topology of uniform convergence on compact sets and Cl(D) 
with the topology of uniform convergence on sets of the form DDK 
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where K c [0, oo) is compact; Q and Q.{D) are separable metric spaces 
isometric to each other. 



Exercise 3. Let 



and 



/?„(/, g) = sup - g(t)\ for /, g e Q 

0<f<n 



P»,d(/,S) - sup 1/(0 - g(t)\ for /,ge Q(D). 

0<t<n 
teD 



Define 



If \ V 1 Pn(f,g) w, ~ 

2" 1 + p„(f,g) 



n=\ 



Pnif, g) 
1 Pn,Z>(/, g) 



^ 2" 1 +pnj)(f,g) 

Show that 

(i) {/,} c Q converges to / if and only if /„ — > / uniformly on 
compact subsets of [0, oo); 

(ii) {/„} c Q(D) converges to / if and only if f n \ DnK -> f ]DnK] uni- 
formly for every compact subset K of [0, oo); 

(iii) {(Pi, . . . , Pd)} where P; is a polynomial with rational coefficients 20 
is a countable dense subset of Q.; 

(iv) {(Pid, • • • , PdD)} is a countable dense subset of O(D); 

(v) r : Q — > Q(D) where t(/) = /jo is a (p,p/))-isometry of Q. onto 
H(D); 

(vi) if V(f, e,n) = {g e Q, : p n (f, g) < e] for / e Q, £ > and 

W, e, «) = (^e O(D) : p n , D (f, g) < e] for / e Q(D), e > 0, 
then 

{V(/,e,n):/eQ,e>0,n = 1,2...} 
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4. Construction of Wiener Measure 



is a base for the topology of Q. and 

{V D (f,e,n) :/efi(Z>),e>0,n= 1,2,...} 

is a base for the topology of O(D). 

Remark. By Exercise|5Jv) any Borel probability measure on O(D) can 
be lifted to a Borel probability measure on Q. 

2nd Step. Define the modulus of continuity A^ 6 (f) of a function / on 
D in the interval [0, T] by 

A T D s (f) = sup{|/(f) - /(*)| : \t~ s\ < St, s 6 D n [0, T]} 

As D is countable one has 

Exercise 4. (a) Show that / : A D (/) < p is measurable in the cr- 
algebra generated by the projections 

k, : 7r{Rf : ? e D] -> R? 

21 Proof. The lemma is equivalent to showing that ^ = cr(#). As each of 
the projection 7r fl ... fjfc is continuous, cr(<^) c To show that SS c cr(<?), 
it is enough to show that Voif, e,ri) €. $ because £l(D) is separable. (Cf. 
Exercise [^Jiv) and|3vi)). By definition 

V D (f, e,n) = {ge fi(D) : P n , D (f,g) < e} 

= QLen(D):p n>D (f,g)<e-^\ 

m=l ' 

= I Jte e CXD) : - < e - -, V// e D n [0, «]}. 

m=l 

The result follows if one observes that each n ti is continuous. □ 

Remark 1. The lemma together with Exercise |31b) signifies that the 
Kolmogorov probability P x on n{Rf : t € D} is defined on the topo- 
logical Borel cr-field of Q.(D). 

2. The proof of the lemma goes through if Q(D) is replaced by Q. 
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Step 3. We want to show that P X (Q,(D)) = 1. By Exercise |Jb) this is 
equivalent to showing that Lt P(A^ Ui (f) < 1) = 1 for all N and k. 

The lemmas which follow will give the desired result. 

Lemma (Levy). Let X\ , . . . X n be independent random variables, e > 
and 5 > arbitrary. If 

P(\X r + X r+l +■■■ +X e \ > S) < e 
V r, I such that 1 <r<l<n, then 

P( sup \Xi+---+ Xj\ > 25) < 2e. 

1<J<K 

(see Kolmogorov's theorem) for every j - 1,2, ... , for every N = 22 
1,2,... and for every k - 1,2, (Hint: Use the fact that the pro- 
jections are continuous). 

oo oo oo 1 

(b) Show that Q.(D) = f| f| \J {A D J (f) < \) and hence Q(D) is 

N=l k=\ 7=1 

measurable in 7r{K.f : t e D). 

Let n h .„ tk : Q,(D) -> R rf x R rf x • • • R d (k times) be the projections 
and let 

K times 

Put 

^ = U{<? fl ... (t : ^ ti < * 2 < . . . < t k < oo; ti e D}. 
Then, as 

&ti...t k U ^...J, C ^ ri ...T,„, 

where 

{t\ ...t k , s\ ... si} c {ti . . .T m ), 
<? is an algebra. Let o~($) be the cr-algebra generated by S. 

Lemma . Let S3 be the (topological) Borel o~ -field ofQ.(D). Then S$ is 
the cr-algebra generated by all the projections 

{n ti .„t k ■ < h < t 2 < ■ ■ ■ < h, ti e D). 
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4. Construction of Wiener Measure 



Remark. By subadditivity it is clear that 



P\ sup \Xi + ■ ■ ■ + Xj\ >26\< ne. 

\}<j<n ) 

Ultimately, we shall let n — > oo and this estimate is of no utility. The 
importance of the lemma is that it gives an estimate independent of n. 

Proof. Let Sj = X x + ■ ■ ■ + X jt E = { sup |5 ; -| > 26). Put 

\<j<n 

£i = {|Si|>2(5}, 

£ 2 = {|Si|<2«5, |S 2 l>2c5}, 



£„ = {|5 ; |< 2(5,1 <y<n-l,|S„|>2<5}. 



Then 



£ = |j£ 7 -, EjnEi = <f> if j*/; 

7=1 



P{£n(|5„|<<5) = P 



n (|5„| < <5)) 



7=1 



< pflJ(Ei n OS,, >($))} 



< J] P(Ej)P(\S„ -Sj\> 6) (by independence) 

7=1 

< (by data). 

- P{£ n (|5„| > 5)} < P(\S n \ >6)<e (by data). 
Combining the two estimates above, we get 
P(E) <€ + eP(E). 

If e > -, 2e > 1. If e < -, — — < 2e. In either case P(E) < 2e. □ 
2 2 1 - e 
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Lemma . Let {X(t)} be a Brownian motion, I c [0, oo) be a finite inter- 
val, F c I n D be finite. Then 

pj Sup \X(t) - X(a)\ > 4d] < C(d) 1 ^-, 

\t,o-eF ) 4 

where \I\ is the length of the interval and C(d) a constant depending only 
on d. 

Remark. Observe that the estimate is independent of the finite set F. 

Proof. Let F = {tj : < t\ < t 2 < . . . < t k < oo}. 
Put 

X { = X(t 2 ) - X(h), ...,X k ^= X(t k ) - X{t k . { ). 
Then X\ . . .X^-i are independent (Cf. Exercise |3c)). Let 

e= sup P x (\X r + X r+l + ••• + > 6). 

\<r<\<k-l 

Note that 

P x (\X r + ■ ■ ■ + X t \ > d) = P(\X(t') - X(t")\ > 6) for some t' , t" in F 

E(\X(Q - X{t")\ A ) , . 

< — (see Tchebyshey s inequality in Appendix) 

(*) C'(f'-f') 

< — — (C" = constant) 

. ci/p 



tf 4 



C'\I\ 2 

Therefore e < — ; — . Now 
S 4 

P x ( sup \X(t) - X(o-)\ > 46) 

t,<reP 

P x ( sup \X{U) - X(ti)\ > 26) 

\<i<k 

- P x ( sup \X\ + h Xj\ >2)<2e (by previous lemma) 

i<j<k-\ 

2C'\I\ 2 _ C\I\ 2 
6 4 ~ ~6^~' 

□ 25 
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4. Construction of Wiener Measure 



Exercise 5. Verify (*). 

(Hint: Use the density function obtained in Exercise|2c) to evaluate the 
expectation and go over to "popular" coordinates. (The value of C is 
d(2d + 1))). 



Lemma . 



sup \X(t) - X(s)\ > p 

\t-s\<h 
lt,se[0,t]nD 

T 

Ti 



P x (A T d H >P) 



<<P(T,p,h) = C^r( 

P 4 V 



+ 1 



Note that cf>(T,p, h) — > as h — » Ofor every fixed T and p. 
Proof. Define the intervals 1^,12,... by 

h h 



r 







i r 

2h 



h 
J 



1 

4/i 



T 



h = l(k- V)h, {k + l)h] n (0, T], k - 1,2, 

Let I\,I%,...I r be those intervals for which 

/ / n[O,r] 9 fc0(j = 1.2,...,r). 
Clearly there are [j] + 1 of them. If \t — s\ < h then t, s e Ij for some 

CO 

j, 1 < j < r. Write D = [j F n where F n c F n+ i and F n is finite. Then 

n=l 



sup \X(t) - X(s)\ > p 

\t-s\<h 
t,se[0,T]nD 



= Pr 



u 

;i=l 



sup \X(t) - X(S)\ > p 

\t-s\<h 
Kt,seDnF„ 



- sup P x I sup sup QX^f) - X(s)\ > p) 

n j t,s£F„ 
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< sup V P x ( sup (\Xj.(t) - X(s)\ > p)\ 

n j-( \t,seF n I 

/\T] \C(2h) 2 , , 
sup — + 1 by the last lemma 

<<p{T,p,h). 

□ 

Theorem . P X (Q(D)) = 1. 
Proof. It is enough to show that 

Lt P x [A' J m<-\ = l (See ExerciseHb)). 

j^oo \ kj 

But this is guaranteed by the previous lemma. □ 
Remark. 1. It can be shown that the outer measure of Q. is 1. 
2. O is not measurable in Yl R-f ■ 

Let P x be the measure on O induced by P x on O(D). We have al- 27 
ready remarked that P x is defined on the (topological Borel o~ field of 
Q.(D). As P x is a probability measure, P x is also a probability mea- 
sure. It should now be verified that P x is really the probability measure 
consistent with the given distribution. 

Theorem . P x is a required probability measure for a continuous real- 
ization of the Brownian motion. 

Proof. We have to show that 

F h ...t k = Px^l. tk for all t u t 2 ...t k in [0, oo). 

Step 1. Let *i, . . . , tk e D. Then 

P,(ff-^(Ai x • • • x A k )) = P je (mt 1 .. 4t CAi x • • • x A*)) 

for every A,- Borel in R rf . The right side above is 

PJpr^fAt x • • • x AjO) - ^!...f t (Ai x • • • x A k ) 

(by definition of P x ). 
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4. Construction of Wiener Measure 



Step 2. We know that T tl h tk - P x ^t l ,t 2 ,-A provided that t\, t%, . . . , h e 
D. Let us pick t\ , . . . , t. , such that each f: € D and n — > t\ as 
n — > oo. For each « and for each fixed / : M. d — > R which is bounded 
and continuous, 

^'••••^[/(X!, . . . , x,)] - E P *[f{x$\ x(tf)))]. 

28 Letting «-»oowe see that 

/•-• A • ' l/(.vi-. . . = E p *[f(x(h), . . .,x(t k ))] 

for all t\, . . . , tk- This completes the proof. □ 

The definition of the Brownian motion given earlier has a built-in 
constraint that all "trajectories" start from X(0) = x. This result is given 
by 

Theorem . P {f : /(0) - 0} = 1. 

Proof. Obvious; because E Px [<f>(x(0))] = <p(x). □ 

Note. In future P x will be replaced by P x and Po = Po will be denoted 
by P. 

Let T x : Q — > Q be the map given by (T x f){t) - x + f(t). T x 
translates every 'trajectory' through the vector x. 




Let us conceive a real Brownian motion of a system of particles. The 
operation T x means that the system is translated in space (along with 
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everything else that affects it) through a vector x. The symmetry of the 
29 physicl laws governing this motion tells us that any property exhibited 
by the first process should be exhibited by the second process and vice 
versa. Mathematically this is expressed by 

Theorem . P x = PT~ l . 

Proof. It is enough to show that 

PxiTxTt' 1 ^ x • • • x A k )) = P(nl\, k (M x • • • x A k )) 

for every A, Borel in R d . Clearly, 

^(Ai x • • • x A k ) = n~l tk {A x -xy.---y.A k -x). 

Thus we have only to show that 



p(0, x,h,x\)... p(t k -i, x k -i, h, x k )dx\ ...dx k 

A k -x 



JAi-xJ J A, 

= | ... I p(0,Q,ti,xi)...p(t k -\,x k -i,t k ,x k )dxi...dx k , 

JAi J At 



which is obvious. □ 

Exercise, (a) If fi(t,-) is a Brownian motion s tarting at (0,0) then 
—=fi(et) is a Brownian motion starting at (0, 0) for every e > 0. 

(b) If X is a cf-dimensional Brownian motion and Y is a d' -dimensio- 
nal Brownian motion then (X, Y)isad+d' dimensional Brownian 
motion provided that X and Y are independent. 

(c) If X t - (Xj ,.. ., Xf) is a J-dimensional Brownian motion, then Xj 
is a one-dimensional Brownian motion. (J - 1,2,... d). 

t(w) - infU : \X t (w)\ > +1} 
- infU : \w(t)\ > 1} 



t(w) is the first time the particle hits either of the horizontal lines 30 
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4. Construction of Wiener Measure 




2. Let {X t } be a J-dimensional Brownian motion, G any closed set in 
R d . Define 

t(w) = M{t : w(t) e G\. 

This is a generalization of Example 1. To see that t is a stopping 
time use 



{T<^} = n lim {w.w{G)eG n }, 



0e[O,j] 
(9 rational 



where 



G„ = { x € R d : d(x, G) < - 

n 



3. Let (X t ) be a <i-dimensional Brownian motion, C and D disjoint 
closed sets in R d . Define 

t(w) = inf {t\ w(t) e C and for some s < t, w(s) € D}. 

t(w) is the first time that w hits C after visiting D. 



5. Generalised Brownian 
Motion 



LET Q. BE ANY space, & a cr-field and (^ t ) an increasing family of 31 
sub cr-fields such that cr(U^) = Let P be a measure on (Q, ^). 

w) : [0, w) x fi -> R J 

is called a Brownian motion relative to (Q, P) if 

(i) X(f, w) is progressively measurable with respect to 

(ii) X(t, w) is a.e. continuous in t; 

(iii) X0, w) - X(s, w) for ? > s is independent of & s and is distributed 
normally with mean and variance t - s, i.e. 

P(X(t,-)-X(s,-)eA\&,)= f 1 exp--^-Jy. 

Note. 1. The Brownian motion constructed previously was concen- 
trated on Q = C([0, oo); R d ), & was the Borel field of D., X(t, w) = 
w(t) and ^ t - cr{X(s) : < s < t}. The measure P so obtained is 
often called the Wiener measure. 

2. The above definition is more general because 
o-{X(s) : < s < t\ c 
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5. Generalised Brownian Motion 



Exercise. (Brownian motion starting at time s). Let Q = C([s, oo); ] 
83 = Borel field of Q. Show that for each x e R d 3 a probability measure 



on Q such that 



32 (i) P*{w : wO) = 4 = 1; 

(ii) P*(X fl eAi ^eA t ) 



= | | ••• | pCs>-Mi>*i)p(*i>*i>*2,*2).- 

■ ■ • p(t k -\x k -i,t k , x k )dx\ . . . dx k , 
V s < t\ < ... <t k . 



For reasons which will become clear later, we would like to shift the 
measure P s x to a measure on C([0, oo); R d ). To do this we define 

T : C([s, oo);R rf ) -> C([0, oo); R d ) 

by 

(Tw)(0 = 

Clearly, T is continuous. Put 



if t>s, 
I w(j), if ? < s. 



Then 

(i) Ps,x is a probability measure on the Borel field of C([0, oo); 

(ii) PsAw : w{s) = x} = 1. 



6. Markov Properties of 
Brownian Motion 



Notation. 1. A random variable of a stochastic process [X(t)} te i shall 33 
be denoted by X t or X(t). < t < oo. 

2. & s will denote the cr-algebra generated by {X t : < t < s}; 
J? s+ = : a > s}; will be the cr-algebra generated by 
U{ : a < s}s > 0. It is clear that \^ t \ is an increasing family. 

3. For the Brownian motion, 3& = the cr-algebra generated by U{J£" ( : 
t < oo} will be denoted by 

Theorem . Let {X t : < t < oo} be a Brownian motion. Then X t — X s is 
independent of J^ s . 

Proof. Let 

< t\ < t2 < h < . . . < tk < s. 

Then the cr-algebra generated by X h , . . . , X tk is the same as the cr- 
algebra generated by 

Xf t , x t2 — x t[ , . . . , x tk — x tk l . 

Since X t - X s is independent of these increments, it is independent 
of cr{X tl ,...,X, k }. This is true for every finite set t\ , . . . , tk and therefore 
X t - X s is independent of & s . 

Let us carry out the following calculation very formally. 

P[X t € A | = P[X t - X s € B | B - A- X s (w), 
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6. Markov Properties of Brownian Motion 



-P[X t -X s eB], by independence, 

34 i.e. 



This formal calculation leads us to 
Theorem . 



P 1 lv - XAw)\ 2 

P[X t e A | = —exp- \ - n dy. 

J {Intfl 1 V 2(t-s) y 

A 

where A is Borel in M. d , t > s. 

Remark. It may be useful to note that p(s, X s (w), t, y) can be thought of 
as a conditional probability density. 



Proof. (i) We show that 

1 ~Tty"-^' 2;/-- v) 



fAiw)= J c^ exp -^--^ 

A 



is -measurable. Assume first that A is bounded and Borel in 
R d . If oj n — > a), then /a(A>«) — * i-e. /a is continuous and 

hence ^-measurable. The general case follows if we note that 
any Borel set can be got as an increasing union of a countable 
number of bounded Borel sets. 

(ii) For any C e & s we show that 

C A 



It is enough to verify (*) for C of the form 

C = {dj : (X h ((o), . . .,X tk (oS)) € A\ X ■■■xA k ; < h < ... < t k < s}, 
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where A,- is Borel in R for i = 1 , 2 . . . k. The left side of (*) is 
then 

J p(0,0,tux tl )p(tux tl ,t2,x, 2 ) . . .p(t k ,x tk ,t,x,)dx tl ...dx t . 

AiX-xAtxA 

35 

To compute the right side define 

f : r(*+W ^ b 

by 

f(u\, . . . ,u k ,u) - X Al (u{) . . . X Ak (u k )p{s, u, t, y). 

Clearly / is Borel measurable. An application of Fubini's theorem 
to the right side of (*) yields 

fdyj X Al (X tl (co))...X Ak (X tk (co))p( S ,X s (co),t,y)dP(oj) 
a n 

= J dy J f(xi ...x k , x s )dF h ,„ tk , s 

A R d x~xR d 
(k+l) times 

= J dy J p(0,0,h,xi)...p(t k -i,t k ,x k ) 

A A[X-xA k xR d 

p(t k , Xk, s, x s )p(s, x s , t,y)dx\ . . . dx k dx s 
J p(0,Q,h,xi)...p(tk-\,Xk-i,tk,Xk)p(tk,x k ,t,y) 

AiX--xAtxA 

dx\ . . . , dxkdy 
(by the convolution rule) 

= left side. 



Examples of Stopping Times. 
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6. Markov Properties of Brownian Motion 



1 . Let (X t ) be a one-dimensional Brownian motion. Define r by 

oo 

{t < s] = H li^ {w : w{6{) € D n , w(9 2 ) e C n ], 

n=l 9ifi 2 rational in [0,.«] 

where 

D n = jx e R d : d(x, D) < , C„ = jx e R d : d(x, C) < ^ j 

Exercise 1. Let t be as in Example 1 . 

(a) If A = {w : X x (w) < t) show that A i & T . 

(Hint: A n |t < 0| ^ ^ )- This shows that £ & . 

(b) P {w : r(w) = oo} = 0. 

(Hint: Pofw : |w(*)l < 1} < / e~ il2 ^ dy W). 

M<r" 2 

Theorem . (Strong Markov Property of Brownian Motion). Let t be any 
finite stopping time, i.e. t < oo a.e. Let Y t = X T+t - X T . Then 

1. P[(Y tl e A u . . . , Y tk e A k ) n A] = P(X h e A,, ...X tk e A k ) ■ P(A), 
V A € J£" T and for every A[ Borel in R d . Consequently, 

2. (Y t ) is a Brownian motion. 

3. (Y t ) is independent of ' 

The assertion is that a Brownian motion starts afresh at every stop- 
ping time. 

Proof. 

Step 1. Let t take only countably many values, say s\, S2, S3 . . .. Put 
Ej = r~ l {sj}. Then each Ej is #V-measure and 

00 

= (J Ej, Ej n E t = j + i. 
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Fix A € & T . 

P[(Y ti eA u ...,Y tk eA k )nA] 

CO 

= £ P[(Y ti €Ai y ft € A,) n A n £,] 

CO 

- ^ P[(X (I+ ,, - X,.) e A x , . . . , X tk+S] - X Sj eA k )nAn Ej\ 

CO 

= £ P[(X (1 € Ai), . . . , (X ft € A*)]P(A n £,) 

(by the Markov property) 
= P{X h eA u ...,X tk eA k )-P{A) 

[tit] + 1 

Step 2. Let r be any stopping time; put t„ - . A simple cal- 

n 

culation shows that t„ is a stopping time taking only countably many 
values. As r„ |T,^ r c J*" T „V n . Let Y ( t n) = X Tn+t - X Tn . 

By Step 1, 

P[(7f <xi,...,Y%> <x k )nA] 
= P(X tl <x u ...,X tk <x k )-P(A) 

(where x < y means x,- < yt i - 1,2, . . . ,d) for every A e & T . As all 
the Brownian paths are continuous, Y) n ' — > Y t a.e. Thus, if jci, . . . ,x k is 
a point of continuity of the joint distribution of X h , . . . , X ft , we have 

P[(7 (l < xu . . . , Y tk < x k ) n A] = P(X tl < xi, . . . ,X fi < x*)P(A) 

V A € ^ T . Now assertion (1) follows easily. 

For (2), put A = Q. in (1), and (3) is a consequence of (1) and (2). □ 



7. Reflection Principle 



LET (X t ) BE A one-dimensional Brownian motion. Then P( sup X s > 39 

Q<s<t 

a) - 2P(X t > a) with a > 0. This gives us the probability of a Brownian 
particle hitting the line x - a some time less than or equal to t. The 
intuitive idea of the proof is as follows. 



Among all the paths that hit a before time t exactly half of them end 
up below a at time t. This is due to the reflection symmetry. If X s - a 
for some s < t, reflection about the horizontal line at a gives a one - 
one correspondence between paths with X t > a and paths with X t < a. 
Therefore 



x 



a 




-*~ Time, t 



t 



P I max X s > a, X t > a \ - I max X s > a,X t < a 
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7. Reflection Principle 
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Since P{X t - a} = 0, we obtain 
< sup X s > a > - P I sup X s > a, X t > a > + P I sup X s > a, X t > a > 

U<i<f J lo<.s<f ) (0<s<t ) 

- 2P{X t > a} 

We shall now give a precise argument. We need a few elementary 



results 



n 

Lemma 1. Let X n - £ Yk where the are independent random vari- 
k=\ 

ables such that P{Y k e B) = P{-Y k e B\i Borel set B c R (i.e. Y k are 
symmetric). Then for any real number a, 



P { max X t > a] < 2P{X n > a) 

[l<i<n ) 

Proof. It is easy to verify that a random variable is symmetric if and 
only if its characteristic function is real. Define 

Ai = {X\ < a,. . . < a,Xi > a), i — 1, 2, . . . , n; 
B - {X n > a\ 

Then A, DAj = Q if i + j. Now, 

P(Ai nB)> P(Ai n {X n > Xi\) 

= P(Ai)P(X„ > Xi), by independence. 
= P(Ai)P(Y i+l + ■ ■ ■ + Y n > 0). 

As y,-+i, . . . , Y n are independent, the characteristic function of + 
• • • + Y n is the product of the characteristic functions of y ;+ i + • • • + Y n , 
so that Yi+i H + F„ is symmetric. Therefore 

p(y i+ i + --- + y„>o)>^. 

Thus PCA; n B) > 2 P ( A i) and 

" 1 1 ( " \ 

P(B) > g PCA; n B) > - 2 P(A ; ) > -P \\J Aj , 
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i.e. 

2P(B)>p|Qa ! J, 
P (max Xi >a\< 2P{X n > a\ 

\l<i<n ) 

□ 

Lemma 2. Let Y,-, ...,Y n be independent random variables. Put X n = 

X Y£ ara<i Zef t = min{/ : Xj > a}, a > and r = oo if there is no such i. 
k=\ 

Then for each e > 0, 

n-l 

(a) P{t < n- l,X n -X T < -6} < P{r < n- l,X n < a}+ 2 P(Yj > e). 

7=1 

n-1 

(b) P{t < ra-l,X„ > a+2e} < P{t < n-\,X n -X T > e}+ £ P{y,- > 6} 

(c) />{X„ > a + 2e\ < P{t < n - \,X n > a + 2e] + P{Y n > 2e\. 
If further, Y\ , . . . , Y n are symmetric, then 

(d) P{maxXi > a,X n < a) > P{X n > a + 2e} - P{Y n > 2e) - 

\<i<n 

2 n ZP{Yj>e} 

7=1 



(e) P{max X t > a] > 2P{X n > a + 2e} - 2 £ P{Y, > e} 

\<i<n j = \ 

Proof. (a) Suppose we {t < n - \,X n - X T < -e] and w e {t < 
n - l,X n < a}. Then X n (w) > a and X n (w) + e < X T ( w) (w) or, 
Xt(w)(w) > a + e. 

By definition of t(w), X T ( w yi(w) < a and therefore, 

Y T (w)(w) = X T(w) (w) - X T(w yi(w) > a + e-a = e 

if t(w) > 1; if t(w) = 1, Y T(w) (w) = X r(w) (w) > a + e > e. 
Thus Yj(w) > e for some j < n - 1, i.e. 
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n-l 

we(j{Yj>e}. 
7=1 

Therefore 

n-l 

{T<n-l,X n -X T <-e}c{T< n -l,X n < a) \J{Yj > e) 

7=1 

and (q) follows. 

(b) Suppose w € {t < n- l,X n > a + 2e] but we {t < n- \,X n -X T > 
e}. Then 

X n (w) - X T(w) (w) < e, 

or, X T ( W )(w) > a + e so that Y r {w){w) > e as in (a); hence Yj(w) > e 
for some j <n-\. This proves (b). 

(c) If w e {X n > a + 2e), then r(w) < n; if w £ {r < n - \,X n > 
a + 2e], then r(w) = n so that < a; therefore Y n (w) - 
X n (w) - X n -\(w) > 2e. i.e. w e [Y n > 2e|. Therefore 

{X n > a + 2e] c {r < n - \,X n > a + 2e] U |F„ > 2e}. 

This establishes (c). 

(d) P{max > a,X„ < a} = P{t < n - \,X n < a) 

l<i<n 

> P{t <n—\,X n —X T < -e) - 2 P(Yj > e), by (a), 

r«-i 



U{T-^,X n -^<-6) 

yt=l 



n-l 

- I ^(^ > e) 

7=1 

= P{r = k,X n -X k < -e} - i; 1 P(Yj > e) 
k=i j=i 

= Z P{t = k}P{X„ -X k < -6} - 2 P(7/ > 6) 

k=l y=l 

(by independence) 
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= 2 P{r = /c}P{X„ - X* > e} - £ P(F ; - > e) (by symmetry) 

*=1 7=1 

= P{t < n - 1,X„ - X T > e} - £ P(F; > e) 

;'=i 

> P{r < n - 1,X„ - X T > e} - P(Yj > e) 

7=1 
n-\ 

> P{t < n - \,X n > a + 2e} - 2 £ P{Yj > e} (by (b)) 

7=1 

> P{X„ > a + 2e| - P{Y n >2e}-2 2 P{F ; > e) (by (c)) 

7=1 

This proves (d). 

(e) P{max X,- > a} = P{max X,- > a, X„ < a] + P{max X,- > a, X„ > a} 

1<!<h \<i<n l<i<n 

= P{max X > a,X n < a) + P{X n > a) 

l<i<n 

= P{X n > a + 2e)-P{Y n > 2e\ + P{X n > a} 
-2"zP{Yj>6) (by(d)) 

7=1 

Since P{X„ > a + 2e) < P{X n > a] and 

P{Y n > 2e\ < P{Y n >€}< 2P{Y n > e), 

we get 



P{max X >a}> 2P{X n > a + 2e) - 2 Y P(Y f > e) 

\<i<n t—i J 

7=1 

This completes the proof. 



Proof of the reflection principle. 
By Lemma[l] 



•imaxx(-) 

li<y<« \n) 



p = P{ max X - > \ < 2P(X(t) > a) 
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By Lemma|2Je), 

p > 2P(X(t) > a + 2.) - 2 J P {(x - X (^^)) > ^} 



.7=1 

Since ' ' ~ ' " 



^— j - X ( — — j are independent and identically distribu- 

t 

ted normal random variables with mean zero and variance - (in partic- 

n 

ular they are symmetric), 

P (M;H 0) H 



P||X^_X»1I>« 



r\x\-\>c\. 



Therefore 



p > 2P(X(t) >a+2e)- In p ( x (^\ > ■ 

CO 

P(X(t/n)>€)= f 1 e-^dx 



2 -loo 



= f — —dx < ^—t—J 1 — f xe 1 dx 
J -yx yn J 



or 



P(X(*/n) > e) < -U^ 2 ' • 

Therefore 

nP(X(t/n) >€)< —^{2t)N{Tm)e~ elnl2t as « ^ +oo. 
2e 



By continuity, 

P{maxX(jt/n) > a) -> P<maxX(5) > a>. 

u<<« J lo<s<r J 
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We let n tend to oo through values 2, 2 2 , 2 3 , . . . so that we get 
2P{X(t) >a + 2e}-2n P{X(t/n) > e\ 
<P I max X(t/n) > a \ < 2P{X(t) > a], 

[l<j<n ) 

or 

2P{X(t) >a}< 2P{X(t) > a] <P (maxX(0 > a\ 

{0<s<t ) 

2P{X(t) > a}, 

on letting n — > +00 first and then letting £ — > 0. Therefore, 
p{m&xX{s) >a\ = 2P{X(t) > a] 

(0<s<t ) 

00 

= 2 J l/y/(27Tt)e- x2/2t dx. 

a 

AN APPLICATION. Consider a one-dimensional Brownian motion. A 
particle starts at 0. What can we say about the behaviour of the particle 
in a small interval of time [0, e)? The answer is given by the following 
result. 

P(A) = P{w : Ve > 0, 3 1, s in [0, e) such that X t (w) > and 
X s (w) < 0} = 1. 

INTERPRETATION. Near zero all the particles oscillate about their 46 
starting point. Let 

A + = {w : V e> 03 1 e [0, e) such that X t (w) > 0}, 
A" = {w : Ve > 03 s e [0, e) such that X,(w) < 0}. 

We show that P(A + ) = P(A~) = 1 and therefore P(A) = P(A + n 
A-) - 1. 

OO / \ OO OO / \ 

A + DP|i sup w>oi = P|l J sup w(t)>l/m\ 



sup w(t) > 1/m 

\0<t<l/n 
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Therefore 
P(A + ) > Lt sup P 

>2 Lt mp P(w(\/n) > 1/m) (by the reflection principle) 

n— i >oom— >oo 

> 1. 

Similarly P(A~) = 1. 

Theorem . Le? fte a one-dimensional Brownian motion, A c (-oo, a) 
(a > 0) and Borel subset ofR. Then 

Po{X t € A, Xj < aVs such that < s < t) 

= J \/^(2jrt)e- yl/2t dy- J \/^(2jrt)e- (2a - y)2/2t dy 

A A 

Proof. Let t(w) = inf{? : w(t) > a}. By the strong Markov property of 
Brownian motion, 

P {B(X{t + s)- X(r) e A)) = P (B)P (X(s) e A) 

for every set B in JP t . This can be written as 

E(X (x(T+syx(T)€A) \^ T ) = P (X(s) e A) 

47 Therefore 

£(X(X(r^(w))-X(r) e A)lgr) - Pq(X(({w)) € A) 

for every function £{w) which is ^-measurable. Therefore, 



/ J „((r < /) n ((X(t - au-)) - XiT)) 6 A) = J y j „(X(f(u-)) e Ak// J (u-) 

In particular, take £{w) - t - r(w), clearly £{w) is ^--measurable. 
Therefore, 

Po((t < t)((X(t) - X(t)) e A)) = J A)(W(w) € A)JP(w)). 

(r<f) 
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Now X(t(w)) = a. Replace A by A - a to get 



(*) PodT < t) n (X(t) e A)) = J P {) (X((Uv) e A -a)dP(w)) 

{r<t} 

Consider now 

P 2a (X(t) e A) = P Q (X(t) e A - 2a) 

- Po(X(t) e2a-A) (by symmetry of x) 
= Pq((t <t)n (X(t) e2a- A)). 

The last step follows from the face that A c (-00, a) and the conti- 
nuity of the Brownina paths. Therefore 

P 2a (X(t)eA)= J Pq(X(£(w)) € a - A)dP(w), (using*) 

{r<t} 

= p ((t <t)n (X(t) € A)). 
Now the required probability 

P {X, eA,X s <aVseO<s<t} = P Q {X t e A] - P {(t <t)n (X t e A)} 
- j \/^(2nt)e' y2/2t dy- J \/^(2nt)e' {2a - y)2 /2t dy. 



The intuitive idea of the previous theorem is quite clear. To obtain 48 
the paths that reach A at time t without hitting the horizontal line x - a, 
we consider all paths that reach A at time t and subtract those paths that 
hit the horizontal line x - a before time t and then reach A at time t. To 
see exactly which paths reach A at time t after hitting x - awe consider 
a typical path X(w). 
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x = a 



□ 



The reflection principle (or the strong Markov property) allows us 
to replace this path by the dotted path (see Fig.). The symmetry of the 
Brownian motion can then be used to reflect this path about the line 
x = a and obtain the path shown in dark. Thus we have the following 
result: 

the probability that a Brownian particle starts from x = at t = 
and reaches A at time t after it has hit x = a at some time t < t is the 
same as if the particle started at time t = at x = 2a and reached A at 
time t. (The continuity of the path ensures that at some time r < t, this 
particle has to hit x = a). 

We shall use the intuitive approach in what follows, the mathemati- 
cal analysis being clear, thorugh lengthy. 

Theorem . LetX(t) be a one-dimensional Brownian motion, A c (-1, 1) 
any Borel subset ofR. Then 



Pq sup \X(s)\< l,X(t)eA\= <f>{t,y)dy, 



0<s<t 




where 



oo 

W,y) - J] (-lTH{2nt)e^- 2n ?l 2t . 



Proof. 



+ 1 
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- 1 

Let E n be the set of those trajections which (i) start at x - at time 
t - (ii) hit x = +1 at some time t\ < t (iii) hit x = -1 at some later 
time T2 < t (iv) hit x - 1 again at a later time T3 < t . . . and finally reach 
A at time f. The number of t's should be equal to « at least, i.e. 

E n = {w : there exists a sequence n, . . . r n of 

stopping times such that < t\ < T2 < . . . < t Tn < t, X(tj) - (-iy _1 , 
X(t) e A}. Similarly, let 

F n - {w : there exists a sequence t\, . . . ,T n of stopping times 
< n < r 2 < . . . < r„ < t,X(rj) - e A] 

Note that 

£l3£ 2 3£ 3 3..., 
F X D F 2 D F 3 D . . . , 
— ' 1 > — ^ 1 > 

E n ^F n = E n+ i U 



Let 



<Kt,A) = P 



sup < l,X(t) e A 

0<s<t 



Therefore 



<f>(t,A) - P[X(t)eA]-P 



sup > l,X{t) e A 
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= J l/^(2nt)e- yl/2t dy-P[(E 1 UF 1 )nAo], 

A 

where 

A () = {X(t) € A) = J lH{2nt)e^ l2t dy - P[(E l n A ) U (Fj n A )]. 

A 

Use the fact that P[A U fi] = P(A) + - P(A n B) to get 
0(/,A) = J~ l/V(27rO^ > ' 2/2 ^- J P[£ , inAo]- J P[F 1 nA ]+/ 5 [£'inFinAo], 

A 

as Eiflfi = E% U F2. Proceeding successively we finally get 

/CO CO 
l/V(27rOe->' 2/2 ^+2](- 1 )' ,/5 ^ nA o]+2 ( - 1)njP[F " nAo] 
I n=l n=l 

We shall obtain the expression for P (E\ n Ao) and -Pt-E^ n Ao], the 
other terms can be obtained similarly. 

E\ n Ao consists of those trajectries that hit x = ± 1 at some time 
t < f and then reach A at time t. Thus _P[.Ei n Ao] is given by the 
previous theorem by 

J \H{2nt)e-^ 2)2 l 2t dy. 

A 

51 £"2 n Ao consists of those trajectories that hit x = ±1 at time t\, hit 
x - -1 at time T2 and reach A at time ?(ti < T2 < 0- 

According to the previous theorem we can reflect the trajectory upto 
T2 about x - - 1 so that P(E2 n Ao) is the same as if the particle starts at 
x = -2 at time f = 0, hits x - -3 at time ti and ends up in A at time ?. 
We can now reflect the trajectory 
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upto time t\ (the dotted curve should be reflected) about x - -3 to 
obtain the required probability as if the trajectory started at x - -4. 
Thus, 

P{E 2 nA ) - J e-^^'^dy. 



Thus 



4>(t 



,A)= I V^ie- (y - 2n)2/2t dy 

1-, — — r^, 



= J <p(t,y)dy. 

A 



The previous theorem leads to an interesting result: 

l 

P 



sup \X(s)\ < l 

0<s<t 



= J <p(t,y)dy 

-l 



Therefore 



sup \X{s)\ > l 

0<s<t 



= l-P 



sup \X{s)\ < l 

0<s<f 
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1 

- -1 -J <f>(t,y)dy, 

-l 

oo 

W,y)= J] (-ir/V(27r0e-0- 2 " )2/2? 

«=-oo 

Case (i). f is very small. 

In this case it is enough to consider the terms corresponding to n - 0, 
±1 (the higher order terms are very small). As y varies from -1 to 1, 

<P(t,y) - \H(2nt) [e-y^ 2t - e^' 2 ' - e ~^^\ . 

Therefore 

l 

J 4>(t,y)dy^4/^(2nt)e- [/2t . 

-l 

Case (ii). t is large. In this case we use Poisson's summation formula 
for <p(t,y): 

CO 

<f{t,y) = J] e^ (2k+l ^ 2t/8 Cos{{k + l)/&ry}, 

k=Q 

to get 

l 

J 4>{t,y)dy - 4/ne-" 2 '!* 

-l 

53 for large t. Thus, P(t > t) = Alne^ 2 '^. 

This result says that for large values of t the probability of paths 
which stay between - 1 and + 1 is very very small and the decay rate is 
governed by the factor e~ n This is connected with the solution of a 
certain differential equation as shall be seen later on. □ 



8. Blumenthal's Zero-One 
Law 



LET X t BE A <i-dimensional Brownian motion. If A € J^o+ = Pi &u 54 

t>0 

thenP(A) - or P(A) = 1. 

Interpretation. If an event is observable in every interval [0, t] of time 
then either it always happens or it never happens. 
We shall need the following two lemmas. 

Lemma 1. Let (Q, SB, P) be any probability space, ^ sub-algebra of 
SB. Then 

(a) L 2 {Q, <£, P) is a closed subspace o/L 2 (0, SB, P). 

(b) If n : L 2 (Q, SB, P) — > L 2 (Q, c €, P) is the projection map then nf - 
E(f\tf). 

Proof. Refer appendix. □ 

Lemma 2. Let CI = C([0, oo); M. d ), Po the probability corresponding to 
the Brownian motion. Then the set {(f>(n tl , . . . , t^) e (p is continuous, 
bounded on M. d X • • • X E. d (k times), n tx ,...,t\ the canonical projection) 
is dense in L 2 (Cl, SB, P). 

Proof. Functions of the form ^>(x(ti), .. ., x(tk) where <f> runs over con- 
tinuous functions is clearly dense in L2{£1, ^ lj?2 ,... A , P) and 

|J |J L 2 (Cl,^ tu ... <tk ,P) 

k h,...,t k 

53 
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8. Blumenthal's Zero-One Law 



is clearly dense in /^(O, SB, P). □ 

Proof of zero-one law. Let 

H, = L 2 (Q, & u P), H = L 2 (Q, SB, P), H 0+ = p| H t . 

t>o 

Clearly H Q+ = L 2 (Q, J*" 0+ , P). 

Let n t . H — > // f be the projection. Then 7r,/ — > no+fVf in //. 
To prove the law it is enough to show that Ho+ contains only constants, 
which is equivalent to no+f = constant V/ in H. As no+ is continuous 
and linear it is enough to show that tto+0 = const of the Lemma|2 

7To+0 - Lt 7T t <p = Lt E((p\ t ) by Lemmaffl 

t^O f-»0 

= U E(4>(h,...,tk)\^ t ). 
;-»0 

We can assume without loss of generality that t < t\ < tj < ■ . ■ < h. 

E(cf>(t u . . . , t k )\&,) = J" <f>( yi , . . .,y k )\H{2n(t x - t)^-^^^ . . . 

. . . \lj{2n{t k - t k -i))e~^^T dy x . . . dy k . 
Since Xq(w) = we get, as t — » 0, 

7To+0 - constant. 
This completes the proof. 

l 

APPLICATION. Let a > I A = {w : j \w(t)\/t a < oo}. Then A e & +- 

o 

i 

For, if < s < 1 , then J \w(t)\/t a < oo. Therefore w e A or not according 

s 

s 

as J \w(t)\/t a dt converges or not. But this convergence can be asserted 
o 



55 



by knowing the history of w upto time s. Hence A e & s . Blumenthal's 
law implies that 



1 1 



J \w(t)\lfdt < oo a.e.w., or, J \w(t)\/t a dt = oo a.e.w. 


A precise argument can be given along the following lines. If < 

s < 1, 

s 

A = {w: J \w(t)\/t a < oo} 
o 

- {w : sup/ ra>i (w) < oo} 

where I n>s (w) is the lower Riemannian sum of \w(t)"\/t a corresponding 
to the partition {0, s/n, ...,s] and each I ns € & s . 



9. Properties of Brownian 
Motion in One Dimension 



WE NOW PROVE the following. 
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Lemma . Let (X t ) be a one-dimensional Brownian motion. Then 

(a) P()imX t - oo) = 1; consequently PiYimX, < oo) - 0. 

(b) P(lim X t - -oo) = 1; consequently P{\im X, > -oo) = 0. 

(c) PflimX, - -oo); ]hnX t = oo) = 1. 

SIGNIFICANCE. By (c) almost every Brownian path assumes each 
value infinitely often. 



Proof. 




n=l 



oo 




(by continuity of Brownian paths) 



First, note that 



Pq sup X(s) < n - 1 - Pq sup X(s) > n 
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= 1 



CO 

21/V(2flZ) J" e - ^ 2 ^ 



o 



Therefore, for any xq and t, 



sup > n\X(to) = xo 

to<S<t 



sup X(s) >h-xq 

Q<S<t-t(> 



(independent increments) which tends to 1 as t —> oo. Consequently, 



Po 



sup X(f) > n 

t>to 



= EP 



sup X(t) > n\X(t Q ) 

t>to 



= £1 = 1. 



In other words, 



for every n. Thus 



Po 



lim supX(f) > n 



= 1 



PQimX, = oo) = l. 

(b) is clear if one notes that w — > -w leaves the probability invariant. 

(c) P(limXf = oo, lim X ; = -oo) 

= P(lim X t = oo) - P(limX f > -oo, limX ; = oo). 
> 1 - P(hmX t > -oo) 
- 1. 



Corollary . Let (X t ) be a d-dimensional Brownian motion. Then 

P(yim\X t \ = oo) = l. 
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Remark. If d > 3 we shall see later that P{ Lt \X t \ = oo) = 1. i.e. 

r— >oo 

almost every Brownian path "wanders" off to oo. 

Theorem . Almost all Brownian paths are of unbounded variation in 
any interval. 

Proof. Let / be any interval [a, b] with a < b. For n - 1, 2, . . . define 

n 

V n (wQ n ) = Wi) ~ ™(ti-i)\ (h = a + (b- a)i/n, i = 0, 1, 2, . . . n), 

i=l 

The variation corresponding to the partioin Q n dividing [a, b] into n 59 
equal parts. Let 



U n {w,Q n ) = Y j \{w{t i )- W {t i - l f 



(=1 
If 

A n (w, Q n ) sup - W(ti-l)\, 

\<i<n 

then 

A K (W, Q n )V n (w, Q n ) > U„{W, Q n ). 

By continuity Lt A n (w, Q n ) - 0. 

n— >co 

Claim. Lt E[(U n (w, Q n ) -(b- a)) 2 ] - 0. 

n— »oo 

Proof. 

E[(U n -(b- a)) 2 ] 



= El^J{X tj -X t] _ l ) 2 -{b-aln)}\ 



7=1 



£[(^(Zj - - a/«)) 2 ], Z y - X f . - 
= nE[(Z 2 -b- a/n) 2 ] 
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9. Properties of Brownian Motion in One Dimension 



(because Zj are independent and identically distributed). 

- n[E(Z A x ) -(b- fl/n) 2 ] - 2(b - a/nf -> 0. 

Thus a subsequence U n . — > b-a almost everywhere. Since A m — > 
it follows that V m (w, Q n ) — > oo almost everywhere. This completes the 
proof. □ 

60 Note, {w : w is of bounded variation on [a, b]} can be shown to be 
measurable if one proves 

Exercise. Let / be continuous on [a, b] and define V n (f, Q n ) as above. 
Show that / is of bounded variation on [a, b] iff sup V n (f, Q n ) < oo. 

n=l,2,... 

Theorem . Let t be any fixed real number in [0, oo), D t = {w : w is 
differentiable at t). Then P(D t ) = 0. 

Proof. The measurability of D t follows from the following observation: 
if / is continuous then / is differentiable at t if and only if 

Lt f(t + r)-f(t) 

r->0 r 
r rational 



exists. Now 

w(t + h) - w(t) , 

w : 

m=l 

and 

Myjh 



Uw(t + h) - wit) 
w : I— —I < M, for all h * 0, rational} 



■iw : \ Xt+h , Xt \<M\/heQ,h*0\<2M f -±— e -^ n dy = 

y n ) h j v(2^) 



Remark. A stronger result holds: 



P 



[jo, 

Vf>0 



- 0. 
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h*U<IU U H(;M^) Is t} 

0<f<l =1 m=l n-m i=l Jfc=i+l,i+2,i+3 K 



and 



n+2 

U 



k\ k- l\ 71 , 
w : w | - | - w I 1 1 < — > const/ y« 



Vi=l i=i+l,...,i'+3 

This construction is due to A. Dvoretski, P. Erdos & S. Kakutani. 



10. Dirichlet Problem and 
Brownian Motion 



LET G BE ANY bounded open set in R d . Define the exit time tg(w) as 61 
follows: 

tg(w) - {inf t : w(t) $ G\. 

If w(0) e G, tq(w) - 0; if w(0) € G, tg(w) is the first time w escapes 
G or, equivalently, it is the first time that w hits the boundary dG of G. 
Clearly tg(w) is a stopping time. By definition X TG (w) € dG, Vw and 
X TG is a random variable. We can define a Borel probability measure on 
<9Gby 

n G {x,T) = P x {X TG eT) 

= probability that w hits T. 

If / is a bounded, real-valued measurable funciton defined on dG, 
we define 

u{x) = E x (f(X TG )) = J f(y)n G (x,dy) 

dG 

where 

E x = E p \ 

In case G is a sphere centred around x, the exact form of nc(x, T) is 
computable. 

Theorem .LetS = S(0; r) = {y e R d : \y\ < r\. Then 

surface area ofY 



7T S (0,r) = 



surface area of S 
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10. Dirichlet Problem and Brownian Motion 



62 Proof. The distributions [F tu ^ k ] defining Brownian motion are invari- 
ant under rotations. Thus jr$ (0, •) is a rotationally invariant probability 
measure. The result follows from the fact that the only probability mea- 
sure (on the surface of a sphere) that is invariant under rotations is the 



Theorem . Let G be any bounded region, f a bounded measurable real 
valued function defined on dG. Define u(x) = E x (f(X TG )). Then 

(i) u is measurable and bounded; 

(ii) u has the mean value property; consequently, 

(iii) u is harmonic in G. 

Proof. (i) To prove this, it is enough to show that the mapping x — > 
P X (A) is measurable for every Borel set A. 

Let = {A € SB : x -> P X (A) is measurable} 

It is clear that tt'] a (B) € c i, V Borel set B in R d x • • • x R d . As 
^ is a monotone class = 

(ii) Let S be any sphere with centre at x, and S c G. Let t = t$ 
denote the exit time through S . Clearly t < tq. By the strong 
Markov property, 



normalised surface area. 



□ 



u(X T ) = E(f(X TG )\3? T ). 



Now 



u(x) = E x (f(X TG )) = E x (E(f(X TG ))\J? T ) 

= E x (u(X T )) = J u(y)n s (x,dy) 
as 

i r 

= — I u(y)dS ; \S \ - surface area of S . 
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(iii) is a consequence of (i) and (ii). (See exercise below). 

□ 

Exercise '. Let u be a bounded measurable function in a region G satis- 
fying the mean value property, i.e. 

u(x) = J u(y)dS 
as 



for every sphere S G. Then 
1 

velS 



1 r 

(i) u{x) = - - - J M(»rfy. 

5 



(ii) Using (i) show that u is continuous. 

(iii) Using (i) and (ii) show that u is harmonic. 

We shall now solve the boundary value problem under suitable con- 
ditions on the region G. 

Theorem . Let G, f, u be as in the previous theorem. Further suppose 
that 

(i) / is continuous; 

(ii) G satisfies the exterior cone condition at every point of dG, i.e. 
for each y e dG there exists a cone Ch with vertex at the point y 
of height h and such that Ch - {y} c exterior ofG. Then 

lim u(x) = f(y), Vy e dG. 

x—>y,xsG 



Proof. 

Step 1. P y {w : w(0) =y,w remains in G for some positive time} - 0. 
Let A n = {w : w(0) = y, w{s) € G for < s < l/n), 

CO CO 

B n = £l-A n ,A= {jA n ,B= H B n . 

n=l n=l 
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10. Dirichlet Problem and Brownian Motion 



As A„'s are increasing, B„'s are decreasing and B n e J^i/„; so that 
B e ^o+. We show that P(B) > 0, so that by Bluementhal's zero-one 
law, P(B) = l,i.e. P(A) = 0. 



where Coo is the cone of infinite height obtained from CV Thus /^(fi) > 
0. 

Step 2. If C is closed then the mapping x — > /^(C) is upper semi- 
continuous. 

For, denote by Xc the indicator function of C. As C is closed (in 
a metric space) 3 a sequence of continuous functions /„ decreasing to 
Xq such that < /„ < 1. Thus E x (f n ) decreases to E x (Xc) = P X (C). 
Clearly x — > E x {F n ) is continuous. The result follows from the fact that 
the infimum of any collection of continuous functions is upper semi- 
continuous. 

65 Step 3. Let 6 > 0, 

N(y;6) - {z € dG : \z-y\<6), 
B s = {w: w(0) € G, X TG (w) € dG - N(y; 6)}, 

i.e. Bs consists of trajectories which start at a point of G and escape for 
the first time through dG at a point not in N(y; 6). If Cg - Bs, then 



P y (B) - lim P y (B n ) > lim P y {w : w(0) - y, w{— ) e C h - {y}} 



Thus 




C*-{y} 




Q n (tv : w(0) =)>|cAn(w: w(0) - 



where A is as in Step l. 
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For, suppose w € Qnfw : w(0) = y}. Then there exists w ra e B$ such 
that w„ — > w uniformaly on compact sets. If w £ An{w : w(0) - y) there 
exists e > such that w(t) e GVf in (0,6]. Let = inf d(w(t),G - 

0<t<£ 

N(y, 6)). Then 8* > 0. If t n - tg(w„) and t n does not converge to 0, 
then there exists a subsequence, again denoted by t n , such that t n > ke > 
for some k e (0, 1). Since w n (ke) e G and w n (ke), w(ke) e G, a 
contradiction. Thus we can assume that converges to and also that 
e > t n Vn, But then 

(*) \w n (tn)-w(t n )\>6*. 

However, as w„ converges to w uniformly on [0, e], 
w n (t n ) - w(t n ) -» w(0) - w(0) = 
contradicting (*). Thus w e A{w : w(0) = y). 

Step 4. lim P x (Bg) = 0. 

For, 66 

Hm" P X (B 6 ) < lim P,(C 5 ) < P y (C s ) (by Step 2) 

x— >y x—>y 

= P y (C s n {w : w(0) - y}) 
<P y (A) (by Step 3) 
= 0. 

Step 5. 

\u{x)-f(y)\ = \ J f(X TG (w))dP x (w)- J f(y)dP x {w)\ 
n n 

< J \f(X TG (w)) - f(y)\dP x (w) + I J (f(X TG (w)) - f(y))dP x {w)\ 
n-B 6 b s 

< J \f(X TG (w))-f(y)\dP x (w) + 211/11^^) 

and the right hand side converges to as x — > y (by Step 4 and the fact 
that / is continuous). This proves the theorem. 
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10. Dirichlet Problem and Brownian Motion 



□ 



Remark. The theorem is local. 

Theorem . Let G - {y e R d : 8 < \y\ < R}, f any continuous function 
on dG = {\y\ = 8} n {\y\ = R}. If u is any harmonic function in G with 
boundary values f, then u(x) - E x (f(X TG )). 

Proof. Clearly G has the exterior cone property. Thus, if 



then v is harmonic in G and has boundary values / (by the previous 
theorem). The result follows from the uniqueness of the solution of the 
Dirichlet problem for the Laplacian operator. 

The function / = on \y\ - R and / = 1 on \y\ - 8 is of spe- 



v{x) - E x (f(X TG )), 



cial interest. Denote by j the corresponding solution of the Dirichlet 
problem. □ 
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Exercise. (i) lid - 2 then 




log/?-log|x| 
log R - log 5 



, VieG. 



(ii) If d > 3 then 




\x\- n+2 - R~ n+2 



Case (i): d = 2. Then 



logj?-log|x| 
log R - log 8 




Now, 




i.e. 



log/?-log|x| 
log R - log 8 



P X (\X TG \ = 8) 



69 

P x (the particle hits |j| = 6 before it hits \y\ = R). 

Fix R and let 5 — > 0; then = P x (the particle hits before hitting 
\y\ = R). 

Let R take values 1, 2, 3, . . ., then = P x (the particle hits before 
hitting any of the circles \y\ - N). Recalling that 

P x Qfa\X t \ = oo) = 1, 

we get 

Proposition . A two-dimensional Brownian motion does not visit a 
point. 

Next, keep 6 fixed and let R — > co, then, 

1 = = 8 for some time t > 0). 

Since any time t can be taken as the starting time for the Brownian 68 
motion, we have 

Proposition . Two-dimensional Brownian motion has the recurrence 
property. 

Case (ii): d > 3. In this case 

P x (w : w hits \y\ = 6 before it hits \y\ = R) 
= (l/|xr 2 - \/R"- 2 )/{\/6 n ' 2 - \/R"- 2 ). 

Letting S^t»we get 

P x (w : w hits \y\ - 6) = (6/\x\f- 2 

which lies strictly between and 1. Fixing 6 and letting \x\ — > oo, we 
have 

Proposition . particle start at a point for away from then it has 
very little chance of hitting the circle \y\ = 6. 
If\x\ < 8, then 

P(w hits S 6 ) = 1 where S s = {y€R d : \y\ = 6). 
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10. Dirichlet Problem and Brownian Motion 



Let 

V s {x) = {5l\x\f- 2 for \x\>6. 

In view of the above result it is natural to extend V$ to all space 
by putting Vg(x) = 1 for \x\ < 6. As Brownian motion has the Markov 
property 

P x {w : w hits S s after time t) 
= J V s (y)\/^{2jTt) d exp -\y\ 2 /2t dy -» as t -» +oo. 

69 Thus P(w hits S s for arbitrarily large t) - 0. In other words, P(w : 

lim \w(t)\ > 8) - 1. As this is true VS > 0, we get the following 

t—>co 

important result. 

Proposition . P(hm \w(t)\ - oo) = 1, 

t—*co 

i.e. for d > 3, the Brownian particle wander away to +oo. 



11. Stochastic Integration 



LET [X t : t > 0} BE A one-dimensional Brownian motion. We want 70 

oo 

first to define integrals of the type J f(s)dX(s) for real functions / e 

o 

L 1 [0, oo). If X(s, w) is of bounded variation almost everywhere then we 

oo 

can give a meaning to J f(s)dX(s, w) - g(w). However, since X(s,w) 


is not bounded variation almost everywhere, g(w) is not defined in the 
usual sense. 

oo 

In order to define g(w) = J f(s)dX(s, w) proceed as follows. 

o 

Let / be a step function of the following type: 



(=1 

We naturally define 



/ = 2 aiX [tiA+l) , < h < t 2 < . . . < t n+1 . 



/n 
f(s)dX(s, w) = 2 cn(X ti+1 (w) - X ti (w)) 

'=! 

n 



g satisfies the following properties: 
(i) g is a random variable; 

71 
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1 1 . Stochastic Integration 
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(ii) E(g) = 0; E(g 2 ) = 2 fl 2fe +1 - *,■) = ||/|| 2 . 

This follows from the facts that (a) X tj+l - X tj is a normal random 
variable with mean and variance (tj + \ - tf) and (b) X tj+l - X tj are inde- 
pendent increments, i.e. we have 



E^J fdXj = 0, £ || J fdX\ 2 



Exercise 1. If 



/ - aiX[ tiyti+l ),0 <h<...< t n+ i, 

m 

8 = ^j b i X lsus M ), 0< Si < ... < S m+U 



(=1 



Show that 



and 



J(f + g)dX(s,w) = J fdX(s,w) + J gdX(s,w) 





CO CO 

J (af)dX(s, w) = a J fdX(s, w), Va 



Remark. The mapping / — > J fdX is therefore a linear L^-isometry of 

o 

the space S of all simple functions of the type 



J] aiX [tuti+l) , (0 <h<...< t n+ i) 



into L 2 (Q, m, P). 
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Exercise 2. Show that S is a dense subspace of L 2 [0, oo). 
Hint: C c [0, oo), i.e. the set of all continuous functions with compact sup- 
port, is dense in L 2 [0, oo). Show that S contains the closure of C c [0, oo). 

oo 

Remark. The mapping / — > J fdX can now be uniquely extended as 

o 

an isometry of L 2 [0, oo) into L 2 (D., 3$, P). 

Next we define integrals fo the type 72 

t 

g(w) = J X{s,w)dX{s,w) 
o 

Put f = 1 (the general case can be dealt with similarly). It seems 
natural to define 

l 

/n 
X(s, w)dX(s) = Lt V X(Zj)(X(tj) ~ X(tj- 1 )) 

] ~ v 

where = to < h < • • • < t n - 1 is a partion of [0, 1] with tj-\ < %j < tj. 
In general the limit on the right hand side may not exist. Even if it 
exists it may happen that depending on the choice of gj, we may obtain 
different limits. To consider an example we choose - tj and then 
- tj-\ and compute the right hand side of (*). If ^ - tj-\, 

n n 

Y J ^ ] {x t] -x t] _ l ) = Y J x t] _ l -{x t] -x t] _ { ) 

7=1 7=1 

= \ffX t] )-(X thl )-\ffX tj -X thl ) 
7=1 7=1 

1 9 9 1 

-[X 2 (l) - X 2 (0)] - - as n -» oo, and sup \tj - tj-i\ 0, 

arguing as in the proof of the result that Brownian motion is not of 
bounded variation. If gj = tj, 

n 

Lt V X tj (X tj - X tM ) = 1 /2X(1) - 1 /2X(0) + 1 12. 

n—>oo / i J J J 1 

Sup \tj-t h i HO 7=1 
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11. Stochastic Integration 



73 Thus we get different answers depending on the choice of and 

hence one has to be very careful in defining the integral. It turns out 
that the choice of = tj-\ is more appropriate in the definition of the 
integral and gives better results. 

Remark. The limit in (*) should be understood in the sense of conver- 
gence probability. 

Exercise 3. Let < a < b. Show that the "left integral" (gj = tj-i) is 
given by 

r f yn , yn X\b)-X\q)-{b-q) 
L X(s)dX(s) = 



and the "right integral" (gj = tf) is given by 

p K< ww ^ X 2 (b)-X 2 (a) + (b-a) 
R I X(s)dX(s) = . 

s 

We now take up the general theory of stochastic integration. To 
motivate the definitions which follow let us consider a <i-dimensional 
Brownian motion {/3(t) : t > 0}. We have 

^.l = 



E[/3(t + s)-0(t) e A\&,] = J l/^(2ns)e~ m lzs dy. 

A 

Thus 

E(f(fi(t + s)-/M)\&t] = j f(y)lN{2ns)e-^ lls dy. 
In particular, if f(x) = e lx u , 

E[e iu W + s)-P(t)Wt] = J e iu - y l/^(27r S )e-W 2/2s dy 

-.;|n| 2 

= e 2 . 
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Thus 
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E[e iu ^ t+S \^t\ - e'"- j8(f) e~' v| " |2 ' /2 

or, 

£ .|- e /H./?(«+.v)+(f+.v)|»| 2 /2|j^j _ e iu./}(t)+t\u\ 2 12 _ 

Replacing iu by 6 we get 

E[e em-\^/2 ! p f] = e eM)->m 2 '\ s > tt w 

It is clear that e d Myt\e\ 2 /2 j s ^-measurable and a simple calculation 
gives 

We thus have 

Theorem . If {/3(f) : t > 0} is a d-dimensional Brownian motion then 
exp[6»./3(f) - \9\ 2 t/2] is a Martingale relative to & t , the cr-algebra gener- 
ated by (B(s) : s < t). 

Definition. Let (Q, SB, P) be a probability space (^)?>o and increasing 
family of sub-cr-algebras of & with & - cr((J & t ). 

f>0 

Let 

(i) a : [0, oo)xO — > [0, oo) be bounded and progressively measurable; 

(ii) b : [0, oo) x Q — > R be bounded and progressively measurable; 

(hi) X : [0, oo)xQ — > Rbe progressively measurable, right continuous 
on [0, oo), V w e Q, and continous on [0, oo) almost everywhere 
on Q; 

6X{t,w)-0 f i>0,w)ds-^ / aO,w)ds 

(iv) Z t (w) = e " 75 

be a Martingale relative to (J? t )t>0- 

Then X(t, w) is called an Ito process corresponding to the parameters 
b and a and we write X t e I[b, a]. 

N.B. The progressive measurability of X => X, is ^-measurable. 
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11. Stochastic Integration 



Example. If {/3(t) : t > 0} is a Brownian motion, then X(t,w) - p t {w) 
is an Ito process corresponding to parameters and 1. (i) and (ii) are 
obvious, (iii) follows by right continuity of fi t and measurability of f} t 
relative to & t and (iv) is proved in the previous theorem. 

Exercise 4. Show that Z t (w) defined in (iv) is ^-measurable and pro- 
gressively measurable. 

[Hint: 

(i) Z t is right continuous. 

(ii) Use Fubini's theorem to prove measurability]. 

t 

Remark. If we put Y(t,w) = X(t,w) - J b(s,w)ds then Y(t,w) is pro- 

o 

gressively measurable and Y(t,w) is an Ito process corresponding to 

the parameters 0, a. Thus we need only consider integrals of the type 

t 

J f(s, w)dY(s, w) and define 



i i i 

J f(s, w)dX(s, w) = J f(s, w)dY(s, w) + J f(s, w)b(s, w)ds. 



(Note that formally we have dY = dX - dbt). 

76 Lemma . If Y(t, w) e I[0, a], then 

t 

Y(t, w) and Y 2 (t, w) - ^ a(s, w)ds 



are Martingales relative to (J^j). 

Proof. To motivate the arguments which follow, we first give a formal 
proof. Let 

9Y(t,w)-%r f a(s,w)ds 

Y e (t) = e 
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Y e - 1 

Then Yg(t) is a martingale, V6. Therefore — - — is a Martingale, V0. 

9 

Hence (formally), 
is a Martingale. 

Step 1. FO, •) e L k (n, P), k = 0, 1, 2, . . . and V?. In fact, for every 
real 9, Yg{t) is a Martingale and hence E(Yg) < oo. Since a is bounded 
this means that 

E(e mt ^) < oo, V0. 

Taking 0=1 and -1 we conclude that £"(e' 7 ') < oo and hence 
E(\Y\ k ) < co,Vk - 0, 1,2,.. .. Since Y is an Ito process we also get 



sup E 

|0|<a 



(r 2 ' i k \ 

Y(t,-)-\ J ads 
e o 



< oo 



Vk and for every a > 0. 

Step 2. Let - [Y(t, ■) - 9 f ads]Y{t) = — Y g (t, •)■ 77 



Define 



d9 



4>aW = J (*e(t, - X e (s, -))dP(w) 



A 

where t > s,Ae & s . Then 

2 



J 4> A (G)d9 = J f[Xg(t,-)-X e (S,-)]dP(w)de. 



01 di A 



Since a is bounded, sup E([Y e (t, •)] ) < °°, and E(\Yf) < oo, V/:; we 

|0|<<* 

can use Fubini's theorem to get 



2 02 

J c/> A (9)d9 = J J [Xg(t, •) - Xg( S , -)]d9 dP(w). 

01 A 0i 
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or 
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J MG)d9 = J Yo 2 (t,-)-Y ei (t,-)dP(w)- J Y 6l (s,-)-Y ei (s,-)dP(w). 

9\ A A 

Let A € J^s and t > s; then, since Y is a Martingale, 



C2 



(0)d0 - 0. 



This is true V#i < 02 and since 4>a(6) is a continuous function of 6, 
we conclude that 

</> A (0) = 0, V<9. 
In particular, <f>A(0) - which means that 

J Y(t, -)dP(w) = J Y{s, -)dP(w), VA e & s , t > s, 

A A 

78 i.e., Y(t) is a Martingale relative to (O, & u P). 
To prove the second part we put 

*«■■■> = &™ 

and 

ilf A {B) = J {Z e (t,-)-Z e (s,-))dP(w). 

A 

Then, by Fubini, 

J ^ A (e)d6 = J J Z e (t, •) - Z e (s, -)d6 dP(w). 

9i A 9i 
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or, 



ifr A {8)d6 = A (0 2 ) - A (0l) 



= Oif A € & s , t > s. 



Therefore 



iff A (9) = o, we. 



In particular, ^a(0) = implies that 



^ 2 (f,w)- 



J w)ds 




is an (£2, jF t , P) Martingale. This completes the proof of lemma^ □ 

Definition. A function 9 : [0, oo) x O — > R is called simple if there exist 
reals *o> si, . . . , s n , . . . 

< Jo < s l < . ■ . < S n . . . < oa, 

s n increasing to +oo and 

0(5, W) - 0/w) 

if j € [sy, where y -(w) is -measurable and bounded. 79 

Definition. Let 9 : [0, oo) x O — > R be a simple function and Y(t, w) e 
7[0, a]. We define the stochastic integral of 9 with respect to Y, denoted 




o 



by 




o 
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k 

= ^ G hl {w)[Y( Sj , w) - Y( Sj - U w)] + 9 k (w)[Y(t, w) - Y(s k , w)]. 
7=1 



I I I I 

S = «1 s 2 S k S k+ i 



Lemma 2. Let cr : [0, oo) x Q — > R be a simple function and Y(t,w) e 
I[0, a]. Then 



f(r,w) = J o-(s,w)dY(s,w) € l[0,acr 2 ]. 



Proof. (i) By definition, cr is right continuous and cr(t,w) is & t - 
measurable; hence it is progressively measurable. Since a is pro- 
gressively measurable and bounded 

ao 2 : [0, oo) x Q. -» [0, oo) 

is progressively measurable and bounded. 

80 (ii) From the definition of £ it is clear that g(t, •) is right continuous, 
continous almost everywhere and ^-measurable therefore £ is 
progressively measurable. 

[«?(*, w)- 7- / acr 2 ds] 

(iii) Z,(w) - e 

is clearly ^-measurable V0. We show that 

E(Z t ) < oo, Vt and E(Z t2 \& tl ) = Z fl if t\ < h- 

We can assume without loss of generality that 6 - 1 (if 4- 1 we 
replace cr by #cr). Therefore 

i 

[g(t,w)-f acr 2 ds] 

Z t (w) = e o 
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Since a and a are bounded uniformly on [0, t], it is enough to show that 
E(e^' w) ) < oo. By definition, 

k 

f(t, w) = Yj Oj-i{w)[Y{sj, w) - Y( S j-i,w)] + e k (w)(Y(t, w) - Y(s k , w)). 

7=1 

The result E(^'' w ^) < oo will follow from the generalised Holder's in- 
equality provided we show that 

E ( e e(w)[Y(t,w)-Y(s,w)]j < m 

for every bounded function 8 which is ^-measurable. Now 
constant for every constant 8, since Y e I[0, a]. Therefore 

£( /(w)[F(,.)-F(.v)]|^ v) = constant 

for every 6 which is bounded and ^-measurable. Thus 81 

E(e e(w) l Y( t ,-)-Y(s^ ) < m 

This proves that E(Z t (w)) e oo. 
Finally we show that 

E(Z t2 \^ tl ) =Z tl (w), if h<t 2 . 

Consider first the case when t\ and ti are in the same interval 

Then 



g(t2,w) - + o- k (w)[Y(t 2 ,w) - Y(t u w)] (see definition), 

h h h 

■ /.v. 

fi 



n n n 

J" acr 2 (s,w)ds - J ' acr 2 (s,w)ds + ^ acr 2 (s, w)ds 
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Therefore 

E{Z t2 (w)\^ h ) = Z (l (w)£(exp[0cr it (w)[yfe,w) - F(fi, w)] - y J ao 2 ds)W h ) 
as Fe/[0,£i]. 

2 * 2 

(*) £(exp[0(Ffe,w) - r(fi,w)) - — f a(s,w)dsW tl ) = 1 

h 

and since cr^w) is -measurable (*) remains valid if is replaced by 
Berk- Thus 

£(Z (2 |^ fl ) = Z, 1 (w). 
The general case follows if we use the identity 



£(£(X|^i)|<^ 2 ) - E(X\<% 2 ) for %c^. 
Thus Z, is a Martingale and w) € I[0, acr 2 ]. □ 

82 Corollary . (i) g(t, w) is a martingale; E(g(t, w)) = 0; 

t 

(ii) % 2 {t,w) - j ao~ 2 ds 
o 

is a Martingale with 

E(f(t,w)) = E( J acr 2 (s,w)ds. 
o 

Proof. Follows from Lemmaffl □ 

Lemma 3. Let cr(s, w) be progressively measurable such that for each 
t, 

t 

E(f cr 2 {s, w)ds) < oo. 
o 
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Then there exists a sequence cr n {s, w) of simple functions such that 
( ' 

lim E I \o- n (s, w) - o-(s, w)\ 2 ds 



-0. 



Proof. We may assume that cr is bounded, for if cr^ = cr for |<r| < N 
and if |<x| > N, then cr n — > cr, V(j, w) € [0, t] x Q. (Ta? is progressively 

measurable and \cr n - cr\ 2 < 4|cr| 2 . By hypothesis cr e L([0, : Q.). 

t 

Therefore E{ J \cr n - cr\ds) — > 0, by dominated convergence. Further, 

o 

we can also assume that cr is continuous. For, if cr is bounded, define 



t 

crh{t,w) - \/h ^ cr(s,w)ds. 

(t-h)v0 



cr n is continuous in t and ^-measurable and hence progressively mea- 
surable. Also by Lebesgue's theorem 

cr/j(f, w) — > cr(t, w), as h — > 0, V?, w. 

Since cr is bounded by C, cr h is also bounded by C. Thus 83 



r 

£"( J* \crh(s,w) - cr(s, w)\ 2 ds) — > 0. 



(by dominated convergence). If cr is continuous, bounded and progres- 
sively measurable, then 

< ^ ( [ns] 
cr n (s,w) - cr\——,w 

is progressively measurable, bounded and simple. But 



Lt cr n (s,w) = cr(s, w). 

n—>co 
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Thus by dominated convergence 



( t 



E 



J \o-„ - cr\ 2 ds 
vo 



as n — > oo. 



Theorem . Let o~{s, w) be progressively measurable, such that 



E{ J cr 2 (s, w)ds) < oo 


for each t > 0. Let (cr„) be simple approximations to o~ as in Lemma\3\ 
Put 



€n(t,W) = J CT n (s,w)dY(s,' 



,w) 


where Y e I[0, a]. Then 

(i) Lt £ n (t, w) exists uniformly in probability, i.e. there exists an al- 

n— >oo 

most surely continuous g(t, w) such that 



Lt PI sup \Ut,w)-t(t,w)\>e\ = 



n— »oo 



\o<f<r 



for each e > and for each T. Moreover, £ is independent of the 
sequence (ctq). 

84 (ii) The map o~ — > £ is linear. 

t 

(hi) ^(f,w)a?i<i^ 2 (f,w)- J ao~ ds are Martingales. 

o 

(iv) T/V ij bounded, % e /[0, acr 2 ]. 
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Proof. (i) It is easily seen that for simple functions the stochastic 
integral is linear. Therefore 

t 

(& - &,)(*, w) = J" (cr n - o- m )(s, w)dY(s, w). 



Since - £ m is an almost surely continuous martingale 

1 

\o<f<r / e 



P\ sup \Ut,w) - U(t,w)\ >e\< -E[^ n -^ m )\T,w)]. 



This is a consequence of Kolmogorov inequality (See Appendix). 
Since 

t 

(gn ~ %mf ~ J a(o-„ - ar m fds 



is a Martingale, and a is bounded, 



(*) E[(g n - % m )\T, w)] = E J" (o- n - o- m fa ds 

vo 



Therefore 



< const -^E J(cr n - cr m ) 2 ds 



Lt E[({ n -{ m ) 2 (T,w)] = 0. 

n,m— >oo 



Thus (g n -%m) is uniformly Cauchy in probability. Therefore there 
exists a progressively measurable £ such that 



Lt P\ sup |£,(f,w)-f(f,w)l > <?| = 0, Ve > 0, VT. 

n^oo \ < f < r 



It can be shown that £ is almost surely continuous. 
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1 1 . Stochastic Integration 



If (cr„) and (cr' n ) are two sequences of simple functions approxi- 85 
mating <x, then (*) shows that 

E[{i~ n -o\T, w y\ -»o. 

Thus 

Ltfu — Lt^ n , 
i.e. <f is independent of (<x„). 

(ii) is obvious. 

(iii) (*) shows that — > £ in L and therefore £„(f, •) — > •) in L 1 for 
each fixed t. Since w) is a martingale for each n, £(t, w) is a 
martingale. 

t 

(iv) £ 2 (?, w) - J a(T 2 n is a martingale for each n. 

o 

Since g n (t, w) — > w) in L 2 for each fixed t and 

£ 2 (f, w) -> £ 2 0, w) in L 1 for each fixed f . 

For f n {t,w) - f{t,w) = ({„ - + and using Holder's in- 
equality, we get the result. 

Similarly, since 

cr n -> cr in L 2 ([0, t] X Q), 
cr 2 ^cr 2 in //([(UJxQ), 

and because a is bounded acr 2 — > acr 2 in L ! ([0, t]xQ.). This shows 

that %l(t, w) - J acr\ds converges to 
o 

t 

9 / 9 

£ (/, w) - I acr (i^ 

o 



87 



for each t in L . Therefore 



fit 



o 



is a martingale. 
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(v) Let cr be bounded. To show that £ € I[0, cr 2 ] it is enough to show 
that 

2 ' 

6£(t,w)-\ facr 2 ds 

e ' o 

is a martingale for each 9, the other conditions being trivially sat- 
isfied. Let 

2 ' 

6Ut,w)- - / acids 

Z n (t,w) = e o 
We can assume that |cr„| < C if \cr\ < C (see the proof of Lemma 



Z n = exp 



(26) 2 f 2 9 f 2 

29t; n (t,w) — I acr n ds + 6 I acr n ds 



Thus 



(**) £(Z„) < const E 



2flf„(f,w)-S2- / oo^ 





- const 



since Z„ is a martingale for each 9. A subsequence Z„ ; converges 
to 

2 ' 

fl? (f,w)- ^- / acr 2 di 
g 

almost everywhere (P). This together with (**) ensures uniform 
integrability of (Z„) and therefore 



dg(t,w)-^- fa<r 2 ds 

e 
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1 1 . Stochastic Integration 
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is a martingale. Thus £ is an Ito process, £ e I[0, ao- 2 ]. 

□ 

Definition . With the hypothesis as in the above theorem we define the 
stochastic integral 

t 

g(t,w) = J cr(s,w)dY(s,w). 
o 

Exercise. Show that d(X + Y) = dX + dY. 

Remark . If cr is bounded, then £ satisfies the hypothesis of the previ- 
ous theorem and so one can define the integral of £ with respect to Y. 
Further, since £ itself is Ito, we can also define stochastic integrals with 
respect to. 

Examples. 1. Let {/3(f) : t > 0} be a Brownian motion; then P(t, w) is 
progressively measurable (being continuous and ^-measurable). 
Also, 

t t t 

J J p 2 (s)ds dP = J J p 2 (s)dP ds = J sds = 
no on o 

Hence 



w)dj3(s, w) 



is well defined. 

t 



2. Similarly f J3(s/2)dJ3(s) is well defined. 

o 



3. However 

t 



J P(2s)dp(s) 
o 



is not well defined, the reason being that fi(2s) is not progressively 
measurable. 
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Exercise 5. Show that fi(2s) is not progressively measurable. 88 
(Hint: Try to show that fi(2s) is not ^-measurable for every s. To show 
this prove that & s + & 2s )- 

Exercise 6. Show that for a Brownian motion fi(t), the stochastic integral 

l 

o 

is the same as the left integral 

l 

L J p{s, -Wis, •) 
o 



defined earlier. 



12. Change of Variable 
Formula 



WE SHALL PROVE the 89 

Theorem . Let cr be any bounded progressively measurable function 
and Y be an Ito process. If A is any progressively measurable function 
such that 

E\ \ A 2 ds \ < oo, W, 



then 

t t 
(*) J Ad£(s, w) = J A{s, w)o-{s, w)dY{s, w), 

o o 

where 

t 

£(t,w) = J o-{s,w)dY{s,w). 



Proof. 

Step 1. Let A and cr be both simple, with A bounded. By a refinement 
of the partition, if necessary, we may assume that there exist reals = 
so, s\, . . . , s n , . . . increasing to +oo such that A and cr are constant on 
[sj, sj + i), say A - Aj(w), cr - crj(w), where Aj(w) and cr ; (w) are .^ s - 
measurable. In this case (*) is a direct consequence of the definition. 
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12. Change of Variable Formula 



Step 2. Let A be simple and bounded. Let (er„) be a sequence of simple 
bounded functions as in Lemma|2] Put 

t 

,w) 



By Step 1, 

t t 

(**) jAd^ n = J A<r n( IY(s.w). 





r 

^„(f,w) = f or n (s,yv)dY(s,' 



t t 
J Adg n = J Acr n dY(s, l 



Since A is bounded, Acr n converges to Act in L 2 ([0, ?] x Q). Hence, 

( r 

by definition, J Acr n dY{s, w) converges to J AcrdY in probability. 

o o 

Further, 



w) = A{s Q , w)[£„Oi , w) - g„(s , w)] + ■ ■ 



+ ■■■+ A(s k , W)[^„(t, W) - % n (Sk-\, W)], 



where so < si < is a partition for A, and g n (t, w) converges to 

£(f, w) in probability for every t. Therefore 



r 

J Ad£ n (s,* 



,w) 


converges in probability to 

t 

J Adf(s,w). 



o 

Taking limit as n — > oo in (**) we get 

, w). 





^ Adg(s, w) - ^ AcrdY(s, l 
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Step 3. Let A be any progressively measurable function with 



E( J A £ ds) <oo,Vt. 
o 

Let A n be a simple approximation to A as in Lemma|2] Then, by Step 



2, 



^ A n (s, w)d^(s, w) = ^ A n {s, w)cr{s, w)dY(s, w). 



By definition, the left side above converges to 

t 

J ' A(s, w)dg{s, w) 
o 

in probability. As <x is bounded A„cr converges to Act in L 2 ([0, t] x Q). 91 
Therefore 



sup | I A n crdY(s, w) - I Acr dy(s,w)\ > e 

)<t<T J J 


allool/e 2 ^ 



(see proof of the main theorem leading to the definition of the stochastic 
integral). Thus 



crdY(s, w) 



converges to 

J Acr dY(s,w) 
o 

in probability. Let n tend to + in (***) to conclude the proof. 



12. Change of Variable Formula 



13. Extension to 

Vector- Valued Ito Processes 



Definition. Let (£1, & , P) be a probability space and (J£" t ) an increasing 92 
family of sub cr-algebras of Suppose further that 

(i) a : [0,co)xQ^ S d + 

is a probability measurable, bounded function taking values in the class 
of all symmetric positive semi-definite dxd matrices, with real entries; 

(ii) b : [0, oo) x Q -» R d 

is a progressively measurable, bounded function; 

(iii) X : [0, oo) x n -> R d 

is progressively measurable, right continuous for every w and continu- 
ous almost everywhere (P); 



Z(t, •) = exp[(9,X(t, •)> - (9,b(s, -))ds 



J (e,b(s,- 



(iv) - l - J (6, a(s,-)e)ds] 

o 

is a martingale for each 9 € M. d , where 

(x,y) = xiyi +■■■ + x d y d , x, y e R d . 
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13. Extension to Vector-Valued ltd Processes 



Then X is called an Ito process corresponding to the parameters b 
and a, and we write X e I[b, a] 

Note. 1. Z(t, w) is a real valued function. 

2. b is progressively measurable if and only if each bi is progres- 
sively measurable. 

93 3. a is progressively measurable if and only if each is so. 

Exercise 1. If X e I[b, a], then show that 

(i) Xi e I[bi,aii], 

d 

(ii) Y = Y J i X i €l[(8,b),(e,a9)l 

i=i 

where 

e = {e u ...,e d ). 

(Hint: (ii) (i). To prove (ii) appeal to the definition). 

Remark . If X has a multivariate normal distribution with mean p and 
covariance (p/y), then F = (0, X) has also a normal distribution with 
mean (Q,n) and variance (8,pQ). Note the analogy with the above exer- 
cise. This analogy explains why at times b is referred to as the "mean" 
and a as the "covariance". 

Exercise 2. If [j3(t) : t > 0} is a <i-dimensional Brownian motion, then 
P(t, w) e I[0, 1] where I = dxd identity matrix. 

t 

As before one can show that Y(t, •) = X(t, •) - Jb(s, w)ds is an Ito 



process with parameters and a. 

Definition. Let X be a <i-dimensional Ito process, cr = (cri, . . . , cr^) a 
<i-dimensional progressively measurable function such that 

e\J (o-(s,-),o-(s, •)> > ds 
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is finite or, equivalently, 



t \ 



e\J oj(s,-)ds 
vo 



< oo, (i = 1,2,... d). 



Then by definition 

; d ' 

f(<r( S ,-),dX(s,-)) = Y j J (r^^dXiis,-). 

i=1 

Proposition . Let X be a d-dimensional ltd process X e I[b, a] and let 
cr be progressively measurable and bounded. If 



£■(/,•) = J TidXiis,-), 



then 

f = (£,...,&) e/[£,A], 

B = (crifci , . . . , cr d b d ) and Ajj = criO-jaij. 

Proof. (i) Clearly A,j is progressively measurable and bounded. 
Since a e S+, A € S d + . 

(ii) Again B is progressively measurable and bounded. 

(iii) Since cr is bounded, each •) is an Ito process; hence £ is pro- 
gressively measurable, right continuous, continuous almost ev- 
erywhere (P). It only remains to verify the martingale condition. 

Step 1. Let = (0i, ... , 6 d ) e R d . By hypothesis, 

t 

(*) £(exp[(0 1 X 1 + • • • + G d X d % -J (0i&j + • • • + e^ii 
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t 



95 Assume that each cr,- is constant on [s,t], o~i = o~,(w) and .im- 

measurable. Then (*) remains true if 0; are replaced by 0;0,-(w) an d since 
cr ( 's are constant over [5, f], we get 

t , t 
£(exp[ J" 0;o-;(j, ) - J" 0i&/<r;(j, -)ds 

1=1 

r 

- i J~ ^ 9fijO-i(s, -)o-j(s, -)aijds]\ s ) 



exp 



J" 2 0iO-i(s, -)dXi(s, ■)- J (9, B)du - 1 J (9,A9)du 



-0 1-1 

Step 2. Let each <x; be a simple function 



H<r,) k i(a-j) 1 



By considering finer partitions we may assume that each cr,- is a step 
function, 



S S\ S2 S n t 

finest partition 

i.e. there exist points sq, s\, S2, ■ ■ ■ , s„, s = sq < si < ... < s n+ \ = t, 
such that on [sj, Sj+\) each cr,- is a constant and .^-measurable. Then (**) 
holds if we use the fact that if ^\ D ^2- 



E(E(mm) = E(m). 
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Step 3. Let cr be bounded, \cr\ < C. Let (cr (M) ) be a sequence of sim- 
96 pie functions approximating cr as in Lemma|2] (**) is true if cr,- is re- 

(h) 

placed by cr. for each n. A simple verification shows that the expres- 
sion Z n (t, •), in the parenthes is on the left side of (**) with cr, replaced 

Z(t,-) = 



u (") 

by cr. , converges to 



t 



- Exp ( J ^ GjO-jis, -)ds _ f XI eibi(T ^ s ' '"> ds ~ 

1 ' 

~2 / Y^OiBjO-iq-jaijds) 

as « — > oo in probability. Since Z n (t, •) is a martingale and the functions 
o~i, o-j, a are all bounded, 

sup E(Z n (t, •)) < °°- 

n 

This proves that Z(t, •) is a martingale. □ 
Corollary . Wi'f/i hypothesis as in the above proposition define 



Z(t) = J (cr(s,-),dX(s,-)). 


Then 

Z(t,-) € /[<cr,6>,OW*] 
where cr* is the transpose of a. 

Proof. Z(f,0 = £(*,•) + "• + &(*,•). □ 

Definition. Let cr(s, w) = (cr/^s, w)) be a « x <f matrix of progressively 
measurable functions with 



E 



f t \ 
J ojj(s,-)ds 
vo 



< oo. 
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13. Extension to Vector-Valued ltd Processes 



If X is a <i-dimensional Ito process, we define 
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o-(s,-)dX(s,-) 




2j o-ij( S ,-)dXj( S ,-) 
i= l o 



Exercise 3. Let 



Z(t,w) = 



o-(s, -)dY(s, •), 



o 

where Y e I[0, a] is a J-dimensional Ito process and cr is as in the above 
definition. Show that 

ZOV) e /[0,o-ao-*] 
is an ^-dimensional Ito process, (assume that cr is bounded). 

Exercise 4. Verify that 



Exercise 5. Do exercise 3 with the assumption that cracr* is bounded. 

Exercise 6. State and prove a change of variable formula for stochastic 
integrals in the case of several dimensions. 

(Hint: For the proof, use the change of variable formula in the one di- 
mensional case and d(X + Y) - dX + dY). 




14. Brownian Motion as a 
Gaussian Process 



SO FAR WE have been considering Brownian motion as a Markov pro- 98 
cess. We shall now show that Brownian motion can be considered as a 
Gaussian process. 

Definition. Let X = {X\ ,.. ., X^) be an Af-dimensional random variable. 
It is called an N-variate normal (or Gaussian) distribution with mean 
H = (jui, . . . ,/un) and co variance A if the density function is 



where AisanN x N positive definite symmetric matrix. 

Note. 1. E(Xi) = m. 

2. Cov(X i ,X j ) = (A) ij . 

Theorem . X = {X\, . . . , Xp/) is a multivariate normal distribution if and 
only if for every 6 e R N , (6,X) is a one-dimensional Gaussian random 
variable. 

We omit the proof. 

Definition. A stochastic process {X t : t e /} is called a Gaussian process 
if Vf i , t2, ■ ■ ■ , tN € /, (X tl ,.. ., X, N ) is an A^-variate normal distribution. 
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14. Brownian Motion as a Gaussian Process 



Exercise 1. Let {X t : t > 0} be a one dimensional Brownian motion. 
Then show that 

(a) X t is a Gaussian process. 99 

(Hint: Use the previous theorem and the fact that increments are 
independent) 

(b) E(X t ) = 0, V/, E(X(t)X(s)) = s A t. 

Let p : [0, 1] = [0, 1] — > R be defined by 

p(s, t) = s A t. 

Define K : l\ [0, 1] ^ l\ [0, 1] by 

l 

Kf(s) = J p(s,t)f(t)dt. 
o 

Theorem . K is a symmetric, compact operator. It has only a countable 
number of eigenvalues and has a complete set of eigenvectors. 

We omit the proof. 

Exercise 2. Let A be any eigenvalue of K and / an eigenvector belonging 
to A. Show that 

(a) Af" + / = with ,1/(0) - - Af\l). 

(b) Using (a) deduce that the eigenvalues are given by A n = 4/(2n + 
l) 2 7r 2 and the corresponding eigenvectors are given by 

/„ - V2 Sin \/2[(2n + \)nt]n - 0, 1, 2, ... . 

Let Zo, Zi, . . . ,Z n . . . be identically distributed, independent, normal 
random variables with mean and variance 1. Then we have 

oo 

Proposition . Y(t, w) - II Z n {w)f n {t)^A n 
converges in mean for every real t. 
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Proof. Let Y m (t,w) = £ Zi(w)fi(t)^- Therefore 
(=0 

n+m 

E{(Y n+m (t, o - Y n (t, o) 2 } = 2 yf 

n+1 

n+m 

E(\\Y n+m (-) - Y n (-)\\ 2 < £ 4 -» °- 

n+l 

□ 

Remark. As each •) is a normal random variable with mean and 

n 

variance £ Aiff(t), Y(t, •) is also a normal random variable with mean 

;=0 

OO 

zero and variance £ Mf}- To see this one need only observe that the 

i=0 

limit of a sequence of normal random variables is a normal random vari- 
able. 

Theorem (Mercer). 

oo 

PCs, = 2 AifiWi(s), (s, t) € [0, 1] X [0, 1]. 

i=0 

The convergence is uniform. 

We omit the proof. 

Exercise 3. Using Mercer's theorem show that {X t : < t < 1} is a 
Brownian motion, where 

oo 

X{t,w) = Y J Zn{w)f n {t)^A n . 

n=0 

This exercise now implies that 
l 

J X 2 (s, w)ds = (L 2 - norm of X) 2 

o 



104 14. Brownian Motion as a Gaussian Process 

= ^ A n zl(w), 
since f n (t) are orthonormal. Therefore 

E(e o ) = E(e »=° ) = | | £(e " " ) 

n=Q 

(by independence of Z„) 

oo 

- ]~[ £(e _ ' u '' z o) 

n=0 

as Zo, Z„ ... are identically distributed. Therefore 
£(e o ) = f]l/V(l+2M,) 

n=0 



n=0 v 

- l/V(cosh)V(2A) 



(2n + l) 2 n 2 



l 



APPLICATION. If F{d) = P(J X 2 (s)ds < a), then 

o 

CO CO 

J e- Aa dF(a) = J e - Aa dF(a) 

-oo 

= E(e- A fi x2(s)ds ) = l/V(cosh)V(2i). 



15. Equivalent For of Ito 
Process 



LET (Q,, & , P) BE A probability space with (^ t )t>0 an d increasing fam- 
ily of sub cr-algebras of & such that <r(U - ^ . Let 

t>0 

(i) a : [0, oo)xQ — > be a progressively measurable, bounded func- 
tion taking values in S J , the class of all d x d positive semidefinite 
matrices with real entries; 

(ii) b : [0, oo) x Q. — > R d be a bounded, progressively measurable 
function; 

(iii) X : [0, oo) x Q — > R rf be progressively measurable, right continu- 
ous and continuous a.s. V(s, w) e [0, oo) x Q. 

For (s, w) € [0, oo)xQ define the operator 




For /, u, h belonging to C™(R d ), C~([0, oo) x R d ) and C^' 2 ([0, oo) x 
R^) respectively we define Yf(t, w), Z u (t, w), Ph(t, w) as follows: 

t 

Y f (t, w) = f(X(t, w)) - J (L s>w (f)(X(s, w))ds, 
o 
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15. Equivalent For of ltd Process 



Z u (t, w) - u{t,X{t, w)) - + L s, w u\ {s,X{s, w))ds, 





t 



P h (t, w) = e\p[h{t, X{t, w)) - J |^ + L s , w hj {s, X(s, w)ds- 

o 

-]■ { (a(s,w)V x h(s,X(s,w)),V x h(s,X(s,w)))ds]. 
1 Jo 

Theorem . The following conditions are equivalent. 

t t 

(i) X e (t, w) = exp[<6>, X(t, w)) - J (9, b(s, w))ds - J (6, a(s, w)9)ds] 

o o 

is a martingale relative to (Q, P), V6 e E. d . 

(ii) Xx(t, w) is a martingale in R d . In particular X[g(t, w) is a mar- 
tingale V6> e R d . 

(iii) Yf(t, w) is a martingale for every f e C^(R d ) 

(iv) Z u (t, w) is a martingale for every u € C^°([0, oo) x M. d ). 

(v) Ph{t, w) is a martingale for every h e C, ' [(0, oo) x R ). 

(vi) Tfte result (v) is true for functions h e C l ' 2 ([0, oo) x R.^) wjY/z 
linear growth, i.e. there exist constants A and B such that \h(x)\ < 
A\x\ + B. 

rrr, r ■ dk dk i . • . -J j , 

The functions — , — , and -- — - — which occur under the integral 

Ot OXi OXiOXj 

sign in the exponent also grow linearly. 

Remark. The above theorem enables one to replace the martingale con- 
dition in the definition of an Ito process by any of the six equivalent 
conditions given above. 

Proof, (i) (ii). X^(t, •) is ^-measurable because it is progressively mea- 
surable. That E{\Xx(t, w)\) < oo is a consequence of (i) and the fact that 
a is bounded. 
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The function A — > is continuous for fixed t, s, w, (t > s). 

X A {s, w) 

Morera's theorem shows that (f> is analytic. Let Ae^. Then 



X A (t,w) 
X A (s, w) 



dP(w) 



is analytic. By hypothesis, 

X A (t,w) 
X A (s,w) 



dP(w) = 1, VA e 



Thus f ^d-fl2!l -dP(w) = 1, V complex /I. Therefore 

E{X A {t,w)\^ s ) = X A {s,w), 
proving (ii). (ii) => (iii). Let 



A(t, w) = exp 



i J'iQ* b(s, w))ds + - ^ (6, a(s, i 



-/ | (fy, /?(J,w)>dj + - J (8,a(s,w)9)ds ,6e 


By definition, A is progressively measurable and continuous. Also 

dA 

| — (t,w)\ is bounded on every compact set in R and the bound is in- 
dt 

dependent of w. Therefore A(t, w) is of bounded variation on every in- 
terval [0, T] with the variation ||A||[o,r] bounded uniformly in w. Let 
M(t, w) = X w (t, w). Therefore 

sup \M(t,w)\<e l/2T sup |<0,a0>|. 

o<f<r o<?<r 

By (ii) M(t, •) is a martingale and since 

El sup \M(t,w)\ ||A|| [0 ,r](w)] < oo.vr, 

\0<t<T I 



M(t, -)A{t 



,.)_! j M(s,-)dA(s,-) 
o 
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15. Equivalent For of ltd Process 



is a martingale (for a proof see Appendix), i.e. Yf(t, w) is a martingale 
when/(x) - e i(0 > x) . 

Let / e C™{R d ). Then / e &{R d ) the Schwartz-space. Therefore 
by the Fourier inversion theorem 



where Yg = Y e i(9,x). Clearly Yf(f,-) is progressively measurable and 
hence ^-measurable. 
Using the fact that 



the fact that ^(R d ) c L l (R d ) and that ^(R d ) is closed under multi- 
plication by polynomials, we get E(\Yf(t, w)\) < oo. An application of 
Fubini's theorem gives E(Yf(t, w)\^ s ) - Yf(s, w), if t > s. This proves 
(hi). 

(hi) => (iv). Let u e C ([0, oo) x R d ). 

Clearly Z u (t, •) is progressively measurable. Since Z u (t, w) is boun- 
ded for every w, E(\Z u (t, w)\) < oo. Let t > s. Then 

E(Z u (t,w)-Z u (s,w)\& s ) = 



= E(u(t, X(t, w) - u(s, X(s, w)\& s ) -£( (— + L tr>w M)(cr, X(cr, w)dcr\^ s ) 



= E(u(t, X(t, w) - u(t, X(s, w))\& s ) + E(u(t, X(s, w) - u(s, X(s, w))\& s )- 



f(x) 




On simplification we get 




E(\Y e (t,w)\) < i + td\e\ Hfeiu + -\e\ 2 imi 




-E( (— + L a u w )(<r,X(<r,w))d(r\& s ) 
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r 

= E(J (L^ w u)(t,X{a,w))da\^ s )+ 



( — (o;X(s,w))d(T\^ s )- 



t 

(— + La", w)(cr, X(cr, w))daW s ), by (iii) 
dcr 

s 

t 

= E (J [La-, w u(t,X(o-,w)) - L^ w u(o-,X(o-,w))]do-\^ s ) 

S 

t 

/du du 
[—{a,X{s,w)) - —(cr,X(o;w))]dcr\& s ) 

s 

t 

= E{ J(L^ w u(t, X(cr, w)) - L^ w u(cr, X(cr, w))]dcr\^ s ) 

s 

t IT 

-E(Jdcrj L PiW ^(cr,X(p,w))dp\& s ) 



s s 



The last step follows from (iii) (the fact that <x > s gives a minus 
sign). 

t t 

= E (J do- J -^-L^ w u{p,X{cr,w))dp\^ s ) 

a 

t <T 

-E(Jdo-J L p ^{o-,X(p,w))dp\& s ) 



s s 

= 



(by Fubini). Therefore Z u (t, w) is a martingale. 

Before proving (iv) => (v) we show that (iv) is true if u e C^' 2 ([0, oo) 
x R d . Let u e C l h ' 2 . 
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(*) Assume that there exists a sequence (u n ) € C~[[0, oo) x R d ] such 

that 

du n du du n du du n d 2 u 
u n — > u, > — , > — , > 

dt dt dx{ dxi dxidxj dx,dxj 

107 uniformly on compact sets. 

Then Z Un -> Z u pointwise and sup(|Z M „(f, w)|) < oo. 

n 

Therefore Z u is a martingale. Hence it is enough to justify (*). 
For every u e C^' 2 ([0, oo) x R d ) we construct au e C^' 2 ((-oo, oo) x 
R d ) = Cl' 2 (R x R d ) as follows. Put 



u(t, x) - 



\u{t,x), if t > 0, 

I C\u{-t, x) + C 2 u{-\, x), if t < 0; 



du du 

matching — , — at t - and u(t, x) and u(t, x) at t = and x) and 
dt dt 

u(t, x) at t = yields the desired constants Ci and C2. In fact C\ = -3, 
C2 = 4. (*) will be proved if we obtain an approximating sequence for 
u. Let S : R be any C function such that if \x\ < 1, 



S(jc) = 



|1, if|x|<l, 
0, if |jc| > 2. 



Ul 2 



Let S n (x) = S ^ — j where \x\ = xf + ••• + x^ +r Pur u n = S n ti. 

This satisfies (*). 
(iv) =3- (v). Let 

h e Cl'\[0, 00) x R d ). 
Put m = exp(/z(7, x)) in (iv) to conclude that 



r 

M(?,w)-/ ( ^ W)) - J 




t 

dh I 

— + L s Ji + -<VA al x h)ds 
ds 2 



e Ks,X(s,w)) 



is a martingale. 
108 Put 



Ill 



A(t, w) = exp - 



rah 
J 5l (s ' 



w) + L StW - (s, w) + -{a{s, w)V x h, V x h)ds 



A((t, w)) is progressively measurable, continuous everywhere and 
l|A||[o,r](w) < Ci e C 2 T 

dA 

where C\ and C2 are constants. This follows from the fact that |— | is 

at 

uniformly bounded in w. Also sup \M(t, w)\ is uniformly bounded in 

0<J<T 

w. Therefore 

E( sup \M(t,w)\ U\\[Q,T](w)) < 00. 

0<t<T 



Hence M(t, -)A - J M(s, -)dA(s, •) is a martingale. Now 




dA(s, w) 
Ms, w) 

Therefore 



dh 1 

— 0, w) + L s , w h(s, w) + -(aV x h, V x h) 
os 2 



1 

M(t,w) = e h ^ w)) + [ e hisMs, W ))^!^l_ 
J Ms,w) 



M(t, w)A(t, w) = P h (t, w) + A(t 



tW) j Ms,X(s, w )) dMs,w) 



Ms, w) 



I I 



I s 

■ J dA(s,w) J < 



M<T,x(<r,w)) dMo-,w) 
A(<t, w) 



Use Fubini's theorem to evaluate the second integral on the right 
above and conclude that Ph(t, w) is a martingale. 
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(vi) => (i) is clear if we take h(t, x) - (9, x). It only remains to prove 
that (v) => (vi). 

(v) => (vi). The technique used to prove this is an important one and 
we shall have occasion to use it again. 

Step 1. Let bit, x) - 9\x\ + 82 X2 + • • • 6dXd - (9, x) for every (t, x) e 
[0, 00) x R d , 9 is some fixed element of R d . Let 



Z(f) = exp 



1 1 
(9,X t ) - J (9,b)ds -j J (9,a9)ds 




We claim that Z(t, •) is a supermartingale. 

Let / : R — > R be a C°° function with compact support such that 
f(x) - xin \x\ < 1/2 and \f(x)\ < 1, Vx. Put/„(x) = nf(x/n). Therefore 
\f n (x)\ < C\x\ for some C independent of n and x and f n (x) converges to 
x. 

d 

Let h n (x) = Yi 9ifn(xi). Then h n (x) converges to (9, x) and \h n (x)\ < 

!=1 

C'\x\ where C is also independent of n and x. By (v), 



Z n (t) = exp 



t t 
h n (t, X t ) - J + L s<w hj ds-^ J (aV x h n , V x h n )ds 



is a martingale. As h n (x) converges to (9, x), Z n (t, •) converges to Z(t, •) 
pointwise. Consequently 

E(Z(t)) = £(hmZ„(0) < lim£(Z„(0) - 1 

and Z(t) is a supermartingale. 

Step 2. E(expB sup |X(j,w)|) < 00 for each t and B. For, let Y(w) = 

0<s<t 

sup \X(s,w)\, Yi{w) = sup \Xi(s,w)\ where X = {X u ...,X d ). Clearly 

0<s<t Q<s<t 

Y < Yy + ■ ■ ■ + Y d . Therefore 



E{e BY ) < E(e BY \e BY 2 . . . e BY d). 
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The right hand side above is finite provided E(e BY i) < oo for each i 
as can be seen by the generalised Holder's inequality. Thus to prove the 
assertion it is enough to show E(e BY i) < oo for each i - 1,2, ...d with 
aB' different from B; more specifically for B' bounded. 

Put 2 = = 6> 3 = . . . = 6 d in Step 1 to get 

t t 
u(t) = exp[0iXi(r) - J Oihis, -)ds - J a n (s, -)ds] 
o o 
is a supermartingale. Therefore 

P[ sup u(s, •)>/!)< \E(u(t)) = \, V/l > 0. 

\0<s<t ) * 

(Refer section on Martingales). Let c be a common bound for both b\ 
and a\\ and let 6\ > 0. Then (*) reads 

P\ sup exp0 1 Xi(j) > AexpiOiCt + Irdjct)) < i. 

\o<s<t 2 / A 



Replacing A by 

e'~ l e 



we get 



i.e. 



P \ sup expBiXiis) > expABi) < e -^^ x ct^\ae\ct ^ 

\0<s<t I 

p(sup X x {s) >a]< g ->Wi+fli«+i/2*?« V0j > 0. 
\0<s<t I 



Similarly 
P 

As 



( sup -X x {s) >a\< e -^6^me\tc^ Vdi > Q 

\0<s<t I 



{Y x {w) > A} | sup Xi(s) > a\ U \ sup -Xi(s) > a\ , 
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we get 

P{Y X >A}< 2e- A6l+e > ct+1/26 * ct , V0i > 0. 
Now we get 

OO 

E{e\pBYi) = ^ J e\p(Bx)P{Yi > x)dx (since Y\ > 0) 
o 

oo 

2 r In 

< — exp(fix - x6\ +9\ct+ -Q\ct)dx 
B J 2 



< oo, if B <9\ 
This completes the proof of step 2. 

Step 3. Z(t, w) is a martingale. For 

\Z„(t, w)\ = Z n (t, w) 
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- exp 



K(Xt) - J i^j- + L StW hAdx ~\ § (a^xK, V ' x h n )ds 



t 

hn(X t ) — J" L sw h n 



exp 



(since a is positive semidefinite and dhjds = 0). 

Therefore \Z n (t, w)\ < A exp(B sup \X(s, w)\) (use the fact that 

s t 

dh n d 2 h n 

\h„(s)\ < C\x\ and — — , - — - — are bounded by the same constant). The 

OXi OXiOXj 

result now follows from the dominated convergence theorem and Step 
2. □ 

Remark. In Steps 1, 2 and 3 we have proved that (v) => (i). The idea of 
112 the proof was to express Z(t, •) as a limit of a sequence of martingales 
proving first that Z(t, •) is a supermartingale. Using the supermartingale 
inequality it was then shown that (Z„) is a uniformly integrable family 
proving thereby that Z(t, •) is a martingale. 
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dh dh 

Step 4. Let h(t, x) e C u ([0, oo)xR d ) such that h(t, x), —{t, x), — (t, x), 

OS OXi 

d 2 h 

- — - — (t, x) are all dominated by a\x\ +{3 for some suitable scalars a and 

OXiOXj 

p. Let 4> n be a sequence of real valued C°° functions defined on W 1 such 
that 

1 1 on \x\ < n 
1 on \x\ > In 



<Pn - 

and suppose there exists a common bound C for 



d(p n d 2 <p n 

"5 — ' a — a — (^")- 
OX,' OXiOXj 

Let h n (t,x) = h(t,x)cf) n {x). By (v) Z/, n (f, w) is a martingale. The 
conditions on the function h and <p n 's show that 



\Z hn (t,w)\ <Aexp S sup |X(j,w)| 

\ 0<.v<r 

where A and B are constants. By Step 2, (Z/jJ are uniformly integrable. 
Also Zh n {t, •) converges pointwise to Ph(t, •) (since /i„ — > h pointwise). 
By the dominated convergence theorem Pf,(t, •) is a martingale, proving 
(vi). 



16. Ito's Formula 



Motivation. Let J3(t) be a one-dimensional Brownian motion. We have 
seen that the left integral 



(*) 



t 

2 J p(s, -)dp 



o 

Formally (*) can be written as 

dp 2 {f) = 2p(t)d/3(t) + dt. 

For, on integrating we recover (*). 
Newtonian calculus gives the result: 

dfw)) = fw)W(t) + \fm)w\f) + ■■■ 

for reasonably smooth functions / and ft. If ft is of bounded variation, 
only the first term contributes something if we integrate the above equa- 
tion. This is because £ dfi 2 - for a function of bounded variation. 
For the Brownian motion we have seen that £ dp 2 — > a non zero value, 
but one can prove that £ d/3 3 , . . . converge to 0. We therefore expect the 
following result to hold: 

dfw)) * fw)W(t) + \rm))d 2 m- 

We show that for a one-dimensional Brownian motion 
Y}AP)\ sup(^) 4 ,... 
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all vanish. 



a = to t\ h h b = t, 



n+l 



V 1=0 ) (=o 

n 

= £o = o, 

!=1 

114 because ySfe+i) - jS(? t ) is a normal random variable with mean zero and 
variance - Similarly the higher odd moments vanish. Even mo- 
ments of a normal random variable with mean and variance o 2 are 
connected by the formula 

o 2 (2k+\)n lk ,k> 1. 

So 

n 

Yjidpf = ^(/%- + i)-/%-)) 4 - 

1=0 

Therefore 



!=0 

= 3^+1 -tif; 

i=0 

the right hand side converges to as the mesh of the partition goes to 0. 
Similarly the higher order even moments vanish. 

More generally, if fi(t, •) is a J-dimensional Brownian motion then 
we expect 

dfW)) * V/G8(r)) • dfi(t) + ^T d ^j- 
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However £ dfijdfij - if i + j (see exercise below). Therefore 

dfW)) * V/06«) • dp{t) + ^Af(/3(t)W 2 (t). 

The appearance of A on the right side above is related to the heat 
equation. 

Exercise 4. Check that dfiidfij = dijdt. 

(Hint: For i = j, the result was proved earlier. If i + j, consider a 
partition = to < h < ■ ■ ■ < t„ = t. Let A*# = - Afe-i). Then 

the right side converges to as « — > oo because A^- and AqS 7 - are inde- 
pendent for k + €). 

Before stating Ito's formula, we prove a few preliminary results. 

Lemma 1. Let X(t, •) € I[b, 0] be a one-dimensional ltd process. Then 

t 

X(t, •) - X(0, •) = Jb(s,-)ds a.e. 
o 

t 

Proof. e\p[GX(t, •) - 6X(0, •) - J b(s, -)ds] is a martingale for each 8. 

o 

Therefore 

t 

E(exp[6(X(t,-)-X(0,-))-6 J b(s,-)ds]) = constant = 1, W. 

o 

Let 



t 

\V(r,-) = X(t. •) --An),-) - J 'b(s,-)ds 

o 

Then 



Z?(exp #W(?, •)) = Moment generating function of w - 1 , W. 
Therefore #(?, •) = a.e. □ 
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116 Remark. If X(t,-) € Z[0,0] then X(t, •) = X(0, •) a.e.; i.e. X(t, •) is a 
trivial process. 

We now state a theorem, which is a particular case of the theorem 
on page ll03l 

Theorem . If h e C U2 ([0,oo) x R d ) such that (i) \h(x)\ < A\x\ + B, 

dh dh d 2 h 

Vx € [0, oo) x R d , for constants A and B (ii) — , - — , - — - — also grow 

at oxi oxiOXj 

linearly, then 

t t 
exp[h{t,B{t, •) - J |^ + jAhj {s,B{s, •) - X - J \Vh\\s,B{s, -))ds] 



is a martingale. 

Ito's Formula. Let / e Cq' 2 ([0, oo) x R d ) and let B(t, •) be a <i-dimensio- 
nal Brownian motion. Then 

t 

f(t,B( t )) - mm) = J %( s ^ 



t t 
+ J(Vf(s,B(s,-)),dB(s,-)) + \J Af(s,B(s,-))ds. 



where 

A = — + + — 

dx\ dx 2 d 

Proof. 

Step 1. Consider a (d + l)-dimensional process defined by 

X (t,-) = f(t,B(t,-)), 
Xj(t,-) = Bj(t,-). 
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We claim that X(t, •) = (Xo, X\,..., Xj) is a (d + l)-dimensional Ito- 
process with parameters 



b = 



|£ + Ia/|(.v./k.v.-)) 0.0....0 



<i terms 



and 



a - 



aoo aoi 
«J0 



«0d 



where 



aoo - IVj/ffoflj,-)), 

«o^(£;/)(^-)), 

For, put /i = Af(t, x) + (0, x), x - (x\, . . . , x<i) e R d , in the previous 
theorem. Then 

— - i/, A/i = AAf, — = A^- + 6j. 

OS OS OXj OXj 

Therefore we seen that 

t 

exp[Af(t,/3(t, •)) + {0,fi(t, -))-A J + \^xfj (s,fi(s, -)ds 

o 

t t 

- X -A 2 J \Vf\ 2 (s,p(s, -))ds - j\6\ 2 t - A(8, J V(f(s,/3(s, -)))ds)] 



is a martingale. 

Consider (A, 6)a(f). We have 



p + 9 



, p = A 



ado 
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Therefore 



(A, 9)a 



d d 

- a^A 1 + A^ aojOj + ^ a 0j 9j+ 

7=1 ;=i 

- ^ 2 |V/| 2 + 2A^-9j + |0| 2 . 



Thus (*) reads 

t t 
exp[Af(t,J3(t, •) + (6,fi(t, •)> - A J b (s, -)ds -^J (a,aa)ds] 

o o 

is a martingale where a - (A, 9) e R rf+1 . This proves the claim made 
above. 

Step 2. Derine cr{s, •) = (1, -V x f(s,fi{s, •))) and let 
t 

Z(f, ■) - J (cr{ S , •), dZ(j, •)> where X * (Xq,X u . . . , X d ) 
o 

1 2 

is the (J + l)-dimensional Ito process obtained in Step 1. Since / € C, ' , 
Z(f, ■) is an Ito process with parameters (cr, b) and cracr* : 



(c-,b) = ?f + Uf, 
os 2 



acr 



«00 P 



1 



«oo - <P, V*/) 



Therefore cracr* = 0. Hence by Lemma^ 



Z(t, •) - Z(0, •) - f (cr, = 0(a.e.), 
o 
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Z(t,-) = J dX (s)- f(Vf(s,/]( S ,-)),d/]( S ,-)) 
o o 

t 

= mm) - mm) - J <v/(/,jS(^ •)), dp( S , o> 

o 



Hence Z(0) = 0. Thus 

t 

mm) - mm) - J (vf(s,P(s, -wins, •»- 





- [l d -L + l - L 

J \ds 2 



A x f\(s,/3(s, -))ds = 0a.e. 



o 

This estabilished Ito's formula. 

□ 

Exercise. (Ito's formula for the general case). Let 

(p(t, x) e C l h a ([0, oo) x R d ). 

If X(t, •) is a <i-dimensional Ito process corresponding to the param- 
eters b and a, then the following formula holds: 

<t>(t,X(t,w))-mX®,w)) 

= J^(s,X(s,x))ds + J(V x <p,dX) + ^ J Y^aij-^T^ds. 

o o ' 1 

This is also written as 

d 2 <p 



1 v-i d l <p 

d(p{s, X(s, w)) = (p s ds + (V x <f>, dX) + - ^ a 'j Q x .Q x dx - 
To prove this formula proceed as follows. 
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(i) Take h(t, x) = Acf>(t, x) + (9, x) in (vi) of the theorem on the equiv- 
alence of Ito process to conclude that 

Y(t,-) = (<f>(t,X(t,-)),X(t, •)) 

is a (d + l)-dimensional Ito process with parameters 



b' = (^+L SyW <f>,b 



and 



A = 



lxl Ixd 

aV x (f> a 
<f x 1 dxd 



(ii) Let cr(t, x) - (1, -V x (p(t, x)) and 



Z(t,-) = J 
o 



(o-(s,X(s,-)), dY(s,-)). 



The assumptions on <p imply that Z is an Ito process corresponding 



(iii) Use (ii) to conclude that 

Z(f. 



,0 = J <o-,b' 



)ds a.e. 



This is Ito's formula. 

(iv) (Exercise) Verify that Ito's formula agrees with the formula ob- 
tained for the case of Brownian motion. 



Note. Observe that Ito's formula does not depend on b. 
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Examples. 1. Let /3(t) be a one-dimensional Brownian motion. Then 

d(e'<t>(J3(t)) = e'd(/>(J3(t)) + (f>(J3(t))d(e') 

= e'(f>'(J3(t))d/3(t) + <f>(J3(t))e t dt+ 

+ -^"{p{t))e'dt. 

2. To evaluate d(ei v(l3(s ' ))ds u(t,P(t))) where V is a smooth function, 121 
put 



X 2 (t,-) = J V(J3(s,-))ds, b 
o 

1 










V((t,-)\ 







a = 







Let X l (t,-)= f3(t, -),X = (XuX 2 ). 



Then 



exploit, ■)-e 2 x 2 (t,-)-e l J hiXisrVds 

o 

t t 
-02 j b 2 (X(s, -))ds - X - j (a6, 0)ds] 



exp[0,Xi(f, •)- -ft]; 

the right side is a martingale. Therefore (X\ , X 2 ) is a 2-dimensio- 
nal Ito process with parameters b and a and one can use Ito's 
formula to write 

d{e^ vifi(s ' ))ds u{t,p{t))) = d(e X2it) u(t,/3(t))) 
at 

+e£ v ^'> dt ^-u(t,p(t))d(t) + e^ v(fi(s ' ))ds u(t,P(t))dX 2 
ox 
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1 £vws,))dsd 

2 ot 

= e^ v ^ s ' ))dt ju(t,mdt + ju(t,/3(s))d(t) + X -^u{t,fi{t))dt 
+u{t,p{tW(PiU-)dtl 

3. Let o-j, fi,i= 1, 2, ... k be bounded and progressively measurable 
relative to a one-dimensional Brownian motion (Q, P). Write 

t t 
Xi(t, -) = f o-i(s, -)dp{s, •) + J Ms, -)ds. 



t 

Then X,-(f, •) is an Ito process with parameters ( J fi(s, -)ds, crj) and 

o 

(X\ , . . . , Xk) is an Ito process with parameters 

It t \ 

J fa(s,-)ds,...,f f k (s,-)ds 
o o 
A - (Aij) where A t j = (TiO-jSij. 

If = 4>{t, Xi(t)..., X k (t)), then by Ito's formula 

d(f> = d 4-ds + p-dXi +■■■ + p-dX k 

OS OX\ OXk 

1 V 2 ^ j 

2^ ' 

(=1 1 

Exercise. Take <ri = 1, o~i - 0, /i = fa - above and verify that if 

<P = e x ^u(t,pm 
then one gets the result obtained in Example 2 above. 
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We give below a set of rules which can be used to calculate dcp in 
practice, where <f> is as in Example 3 above. 

1. With each d/3 associate a term y](df) 

2. If <p - <p{t,X\, . . . ,Xk), formally differentiate <f> using ordinary 123 
calculus retaining terms upto the second order to get 



3. Formally write dX{ - fidt + aidfii, dXj - (Tjdfij + fjdt. 

4. Multiply dXjdXj and retain only the first order term in dt., For 
dfiidfij substitute Sijdt. Substitute in (*) to get the desired formula. 

Illustration of the use of Ito Calculus. We refer the reader to the sec- 



G 

satisfies Au = in a region G with u = u(X(t)) on the boundry of G 
(here t is the first hitting time). 



The form of the solution is given directly by Ito's formula (without 
having recourse to the mean value property). If u - u(X(t)) satisfies 
Au = then by Ito's formula 




tion on Dirichlet problem. There it was shown that 





du(X(t)) - (Vu,dX). 
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Therefore 

t 

u(X(t)) = u(X(0)) + J (Vu(X(s)), dX(s)) 
o 

124 

Assuming Vw to be bounded, we see that u(X(t)) is a martingale. By 
the optional stopping theorem 

E(u(X(t)) = u(X(0)) = u(x). 

Thus Ito's formula connects solutions of certain differential equa- 
tions with the hitting probabilities. 



17. Solution of Poisson's 
Equations 



LET X(t, •) BE A J-dimensional Brownian motion with (Q, P) as 
usual. Let u(x) : R d -> R be such that ^Aw - /. Assume u e C|(R rf ). 

1 ' 
Then L StW u - -Am = / and we know that u(X(t, •)) - J f(X(s, -))ds is 

o 

a (Q, J^, P)-martingale. Suppose now that u(x) is defined only on an 
open subset G c R d and -Am = / on G. We would like to consider 



Z(t, -) = u{X{t,-))- J f(X(s,-))ds 
o 

and ask whether Z(t, •) is still a martingale relative to (fl, & t , P). Let 
t(w) = inf {t, X(t, w) € dG). Put this way, the question is not well-posed 
because Z(t, •) is defined only upto time t(w) for u is not defined outside 
G. Even if at a time t > r(w)X(t, w) e G, one needs to know the values 
of / for t > t(w) to compute the integral. 

To answer the question we therefore proceed as follows. Let At — 
[w : t(w) > t]. As t increases, At have decreasing measures. We shall 
give a meaning to the statement 'Z(t, •) is a martingale on A t \ Define 

rAf 

Z(t, •) - u(X(t A t, •)) - J f(X(s, -))ds. 

o 
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1 7. Solution of Poisson 's Equations 



Therefore 



zov) = 



Z(t), on A t 
Z(t,0, on(A ; ) c . 



Since Z(t, •) is progressively measurable upto time r, Z(?, •) is 
measurable. 

Theorem . Z(t, •) w a martingale. 

Proof. Let G n be a sequence of compact sets increasing to G such that 
G n c G° +1 . Choose a C°° function 0„ such that 0„ = 1 on G„ and 

support <p n c G. Put u n - <p n u and f n = \hu n . Then 



is a martingale for each n. Put 

r n = M{f.X(t, -)€G n } 

Then Z n (r„ A t, •) is also a martingale (See exercise below). But 

Z„(t„ A = Z(r n A 0- 

Therefore M„(f, •) = Z(r„ A f, •) is a martingale. Observe that t„ < 
t„+i and since G n t G we have t„ t r. Therefore Z(j n Kt) — > Z(r Kf) (by 
continuity); also |M„(f, -)| < IMU + 11/IUf. Therefore Z(r At) — Z(t, •) 
is a martingale. □ 

Exercise. If M(t, •) is a (O, P )-martingale, show that for my stopping 
time t, M(t A t, •) is also a martingale relative to (& t ). 
[Hint: One has to show that if ti > t\, 



2 




o 



M(t A r 2 , w)dP(w) = M(T A ?! , w)dP(w), VA € . 
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The right side = 

J M(t u w)dP(w)+ J M(T,w)dP(w). 

An(r>?!) An(r<ti) 

The left side 

= J M(t 2 ,w)dP(w) + J M(T,w)dP(w). 

An(j>h) An(T<fi) 

Now use optional stopping theorem]. 

Lemma . Let G be a bounded region and t be as above. Then E x (t) < 
oo, Vx e G, where E x = E p \ 

Proof. Without loss of generality we assume that G is a sphere of radius 

R 2 - \x\ 2 1 
R. The function u(x) - ■ > and satisfies -Aw = -1 in G. By 

d 2 

the previous theorem 

TAt 

u(X(t At,-) + J ds 


is a martingale. Therefore 

E x (u(X(t A t, •))) + E x (t At) = u(X(0)) = u(x). 

Therefore E x (t A f) < u(x) (since u > 0). By Fatou's lemma, on 
letting t — > oo, we obtain E x (t) < u(x) < oo. Thus the mere existence of 

a u satisfying -Au = 1 helps in concluding that E x (t) < oo. □ 
Theorem . Let u e C^(G) and suppose that u satisfies 

(*) = f in G, 

u-gon dG. 

T 

Then u(x) = E x [g] - E x [ J f(X(s, -))ds] solves (*). 
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1 7. Solution of Poisson 's Equations 



Remark . The first part of the solutin u(x) is the solution of the homo- 
geneous equation, and the second part accounts for the inhomogeneous 
term. 

_ ™ _ 

128 Proof. Define Z(t, •) = u(X(t At)) — J f(X(s, -))ds. Then Z is a mar- 

_ o 
tingale. Also |Z| < ||w||oo + t||/||oo. Therefore, by the previous Lemma, 
Z(t, ■) is a uniformly integrable martingale. Therefore we can equate the 
expectations at time t - and at time t - oo to get 

T 

u(x) = E x (g) - E x [ J f(X(s,-))ds]. 
o 

□ 



18. The Feynman-Kac 
Formula 



WE NOW CONSIDER the modified heat equation 
du 1 

(*) — + -Am + V{x)u{t, x) = 0, < t < T, 

at 2 

where u(T, x) = f(x). The Feynman-Kac formula says that the solution 
for s < T is given by 

(**) u{s, x) = E StX (e£ vms » ds f(X(T))). 

Observe that the solution at time s depends on the expectation with 
respect to the process starting at time s. 

Note. (**) is to be understood in the following sense. If (*) admits a 
smooth solution then it must be given by (**). We shall not go into the 
conditions under which the solution exists. Let 

Z(r, •) = u(t, X(t, -))e£ nxtaW t > s 

By Ito's formula (see Example 2 of section[l^Ji, we get 

t 

Z(t, •) = Z(s, •) + J eX' v ^ d(T \Wu(A, X(A)), dX{A)), 

s 

provided that u satisfies (*). Assume tentatively that V and Vm are 
bounded and progressively measurable. Then Z(t, •) is a martingale. 
Therefore 

E s , x (Z(T,-)) = E z , x (Z(s,-)), 
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1 8. The Feynman-Kac Formula 



E s , x (u(T,X(T)))e£ v( - XM)dcr = u{s,x). 
This proves the result. 

We shall now remove the condition V„ is bounded and prove the 
uniqueness of the solution corresponding to (*) under the assumption 
that V is bounded above and 

\u(t,x)\<e A+lxr , a<2, on [s,T). 

In particular, the Feynman-Kac formula extends the uniqueness the- 
orem for the heat equation to the class of unbounded functions satisfying 
a growth condition of the form given above. 

Let be a C°° function such that <f> - 1 on \X\ < R, and = outside 
|jc| > R + 1. Put u R (t, x) = u(t, x)(f>, 

Z R {t,x) = u R {t,x)e^ V(X((T)d(T) . 
By what we have already proved, Z R (t, •) is a martingale. Let 

t r (u)) = M{t : t > sco{t) e S(0;R) = {\x\ < R}}. 
Then Z R (t A t r , •)) is also a martingale, i.e. 

u R (tAT R ,X(tAT R ,.)) e r R v(^ 

is a martingale. Equating the expectations at time t = s and time t = T 
and using the fact that 

U R (t A T R , X(t A T R , •)) = U(t A T R , X(t A T R , •))), 

we conclude that 

u(s, x) = E s , x [u(t r A T, X(t r A T, y «^] 
= E s , x [X (TR *T)f(X(T))e£ y VW]+ 

f V(X(s))ds 

+ E s , x [X (TR < T) u(T R ,X (TR) e* ] 
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Consider the second term on the right: 

\E s , x [X(t r <t)u(t r , X{t r ))J: r v(*W]\ 
< A'e R "P[ R < T] 

(where A' is a constant given in terms of the constants A and T and the 
bound of V) 

= A'e R "P[ sup \X(cr)\ > R]. 

S<(T<T 

P[ sup \X(<t)\ > R] is of the order of e ~ c(T)Rl and since a < 2, the 

s<a<T 

second term on the right side above tends to as R — > oo. Hence, on 
letting R — > +oo, we get, by the bounded convergence theorem, 

u(s,x)=E s , x [f(X(T))e£ mds ] 

Application. Let yS(f, •) be a one-dimensional Brownian motion. Recall 

4 

(Cf. Reflection principle) that P{ sup < 1} is of the order of -e - 

Q<s<t n 

n 2 t 

—. The Feynman-Kac formula will be used to explain the occurance 

o 

. , . n 1 . , _. jt 2 A 2 , 

of the factor — m the exponent. First observe that — = — where A is 

8 8 2 

the first positive root of Cos A = 0. Let 

t(w) = infU : 16(01 > 1). 



Then 



P{ SUp |0tv)|<l} = P{T>f}. 

0<s<t 



Let (f>(x) = E x [e AT ], A < 0. We claim that cf> satisfies 
^"+^ = 0, |x|<l, 

= 1, W = l. 
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1 8. The Feynman-Kac Formula 



Assume <f> to be sufficiently smooth. Using Ito's formula we get 

d(e At <f>(/3(t)) = e At <t>'Q3{t)W{t) + UW)) + -</>" 
Therefore 

t 

e At <f>W)) ~ m.0)) = J e As <p'(/3(s))d/3(s)+ 
o 

t 

+ J [Xms)) + \<P"(fi{s))\e As ds, 
o 

i.e. 

t 

e At <p(fi{t)) ~ 008(0)) - J VA<p(fi{s)) + ^<f>"(J3(s))]e As ds 
o 

is a martingale. By Doob's optional sampling theorem we can stop this 
martingale at time r, i.e. 

tf\T 

e A ^<p(J3(t A t)) - 0(0(0)) - J WC8(j)) + ^"0S(j))]^dj 

o 

is also a martingale. But for s < t A t, 

Acp + jcp" = 0. 

Thus we conclude that <p(J3(t A r))e^™' is a martingale. Since A < 
and <p(fl(t A t)) is bounded, this martingale is uniformly integrable. 
Therefore equating the expectation at t - and t - oo we get (since 

W.T)) = 1) 

0(x) = E x [e Ar l 

By uniqueness property this must be the solution. However (*) has 
a solution given by 

Cos(V(2/bc)) 
Cos(V(2^)) ' 
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Therefore 

IfF(0 = P(t> 0,then 



00 

; 



e*«/F(/) - E (e AT ). 



A theorem on Laplace transforms now tells us that (1) is valid till 

1 n 2 

we cross the first singularity of ; . This occurs at A = — . By 

Cos(V(2/i)) 8 
the monotone convergence theorem 

£ [e™ 2 / 8 ] = +oo 

n 2 n 2 
Hence f e M dF(t) converges for /I < — and diverges for A > —. 
8^8 

Thus — is the supremum of A for which f e At dF(t) converges, i.e. sup 

8 o 
[/I : Eo(e Ar )] exists, i.e. the decay rate is connected to the existence or 

the non existence of the solution of the system (*). This is a general 

feature and prevails even in higher dimensions. 



19. An Application of the 
Feynman-Kac Formula. The 
Arc Sine Law. 



LET f3(t, •) BE THE one-dimensional Brownian motion with /3(0, •) = 0. 
Define 

t 

6(w) = lf X [Qt00) (p(s,w))ds. 
o 

€t(w) is a random variable and denotes the fraction of the time that a 
Brownian particle stays above the x-axis during the time interval [0, t\. 
We shall calculate 

P[w : ft(w) <a] = F t {a) 

Brownian Scaling. Let X t (s) - —J3(ts). Then X t is also a Brownian 
motion with same distribution as that of f}(s). We can write 



= j ^[0,o 



The g t (w) - time spent above the x-axis by the Brownian motion 
X t (s) in [0, 1]. Hence F t {a) is independent of t and is therefore denoted 
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19. An Application of the Feynman-Kac Formula.. 



by F(a). Suppose we succeed in solving for F(a); if, now, 

t 

£(w) - J X l0>oo) (fi( S ))ds = ft, 



then the amount of time f3(s, •) > in [0, t] is t (amount of time X t (s) > 
in [0, 1]). Hence we can solve for P[g*(w) < a] = G t (a). Clearly the 
solution of G t is given by 

G t (a) = F(a/t). 

It is clear that 

F(a) 



if a < 0, 

1 if a > 1. 



Hence it is enough to solve for F(a) in < a < 1 . Let 

u A (t,x) = E x [e- {X & X ^ Ms ' w))ds) ] 

Then 

l 

ki(/,0) - = J e~ tx dF(x). 

o 

Also note that w^f, x) is bounded by 1, if A > 0. By the Feynman- 
Kac formula (appropriately modified in case -A is replaced by -^A) 
wi(f, x) satisfies 

5m 1 d 2 u ^ 
/ ^ \ <9? 2 dx 2 

Id 2 " 

= 28*' X< °' 

and w(0, x) = 1. Let 

oo 

4> a (x) = a J u(t,x)e~ at dt, a > 0, where u-u\, 
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J u(t,x)(-de- at ). 




A simple integration by parts together with (*) gives the following 
system of ordinary differential equations for <p a : 

~ \<Pa + (« + l)0a = a, * > 0, 
- ^(/V + = a, X < 0. 

These have a solution 

a(jc) = + Ae W(2(«+D) + flg -W(2(a+l)) > x > 0, 

or + 1 

= 1 + Ce W(2a) + De" W(2a) , x < 0. 

136 

However w is bounded by 1 (see definition of u\(t, x)). Therefore <p a 
is also bounded by 1 . This forces A = D = 0. We demand that <f> a and 
dd> a 

— — should match at x - 0. (Some justification for this will be given 

ax 

later on). 

Lt <p a (x) - Lt <p a (x) 
*-*0+ x-*0- 

gives 

a 

+ B = C + \. 



l+a 

Similarly we get -By/(2(a + 1)) = C^(2a) by matching Solv- 

cix 

ing for B and C we get 



C = 



(1 +a)(Va + V(a +1 ))' 
1 



V(i + ff)(V« + V(« + i))' 

Therefore 



or+l V(or+l)' 
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19. An Application of the Feynman-Kac Formula.. 



i.e. 

oo 

J V(ar + 1) 



Using Fubini's theorem this gives 

a + t, a + I 

or 

Fr _l _ 1 , . t dFjx) _ 1_ 

* L i+£/ a J ~ v M + (W' Le - J l + rx"Vd + 



r) 





This can be inverted to get 



<iF(;c) - -■ 



7T VW1 ~~ x )) 
(Refer tables on transforms or check directly that 
1 

2 r 1 1 

1 +/3xVWl -x)) " V(l + £> 



by expanding the left side in powers of (fi). Therefore 
2 

F(a) = - arcsin {sja), < a < 1. 
/r 

Hence G f (a) = | arcsin (V(f )), < a < i.e. 

P[£ < a] = - arcsin (V(-)), < a < t. 
n t 

This result goes by the name of arc sine law for obvious reasons. 
We now give some justification regarding the matching conditions 
used above. 
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The equation we solved was 

a<f>-±<f>" + Vcf> = f 

where was bounded V > 0. Suppose we formally use Ito's formula to 
calculate 

= e -^vms,-y>ds { _ mSi . ))dt + ?± m)dm 

(see Example 2 of Ito's formula). Therefore 

(Z(t, •) - <p{p{t, •))«" XVw^))^ + J* .) eX p(- J~(c* + V)dcr)ds 

o 

is a martingale. Since 0, / are bounded and V > 0, 138 

oo 

|Z(r, 01 < UWoo + ll/IU J <r°^ < + Cll/lU. 
o 

Therefore Z(?, is uniformly integrable. Equating the expectations 
at time and oo gives 

oo 

(*) 0(0) - £ J [/(PCs, 0)«"°^' m<r¥<7) ]^. 

o 

This is exactly the form obtained by solving the differential equa- 
tions. In order to use Ito's formula one has to justify it. If we show 
that Ito's formula is valid for functions having a discontinuity in the 
second derivative, (*) will be a legitimate solution and in general there 

is no reason why the second derivatives (or higher derivatives) should be 

dtp 

matched. This partially explains the need for matching tp and — only. 

dx 



144 



19. An Application of the Feynman-Kac Formula.. 



Proposition . Let B(t, •) denote a one-dimensional Brownian motion. 
Suppose <p eCj and satisfied 

acp - + Vcp = f, 



Then 



is a martingale. 



t 

<PW))- J f(fi(s))ds 
o 



Proof. Let (0 e ) € C| such that a<p £ - \<p" + V<p £ + V<f> £ - f £ and such 
that (i) (f> £ converges to (p uniformly on compact sets, (ii) (f>' £ converges to 
(/>' uniformly on compact sets, (iii) <f>'J converges pointwise to <j>" except 
at 0. We may suppose that the convergence is bounded. □ 

t t 
Claim. J f £ (j3(s))ds converges to f f(B(s))ds a.e. As f £ (j3(s)) converges 

o o 
to f(B(s)) except when 6(s) = 0, it is enough to prove that 

(*) P [w: Lebesgue measure (s : 8(s) - 0) > 0]= 0. Let X^} denote 
the indicator function of {0}. Then 



E J X {0] (P(s))ds = J EX m {6{s))ds = 0. 



Thus (*) holds and establishes the claim. Now 



t 



<p £ (P(t)) - J fields 


is a uniformly bounded martingale converging to 

t 

<p(P(t)) ~ J f(fi(s))ds. 
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Therefore 

t 



is a martingale. 



20. Brownian Motion with 
Drift 



LET Q = C[0, oo;R rf ], JF = BOREL cr-FIELD of O, {X(f, •)} = Brow- 
nian motion, & t = <t[X(s, •) : < j < f], P x = probability measure 
on corresponding to the Brownian motion starting at time at x. 
& = cr(U ' Let b : R d — > be any bounded measurable funci- 

f>0 

ton. Then the map (s, w)\ — > is progressively measurable and 

Z(t, •) = exp[ J (b(X(s, •)), dX(j, •)) - \ J HX(s, -))\ 2 ds] 
o o 
is a martingale relative to (Q, ^ , P*). Define Q' x on ^ by 



ei(A) = J z(t,-)dp x , 



i.e. Z(f, •) is the Radon-Nikodym derivative of Q' x with respect to P x on 

Proposition . (i) Q' x is a probability measure. 

(ii) {Q' x '■ t > 0} is a consistent family on U & t , i.e. if A e a«<i 
? 2 > fi then Q' X 1(A) = Q' X 2(A). 

Proof. Q' x being an indefinite integral, is a measure. Since Z(t, •) > 0, 
Q' x is a positive measure. £&(Q) = E x (Z(t,-)) = E x (Z(0,-)) = 1. This 
proves (i). (ii) follows from the fact that Z(Y, •) is a martingale. 
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20. Brownian Motion with Drift 



If A e & t , we define 

QAA) = Qf\ 

The above proposition shows that Q x is well defined and since (J? t ) 
is an increasing family, Q x is finitely additive on (J & t . □ 

Exercise. Show that Q x is countably additive on the algebra 1J & t . 

f>0 

Then Q x extends as a measure to & - <t(1J ^). Thus we get a 

f>0 

family of measures {Q x : xe R d ) defined on (Q, J£"). 

Proposition . If s < t then 

Q x (X t e A\& s ) = Q X ( s) (X(t - s) e A) cue. 

Definition. If a family of measures {Q x } satisfies the above property it 
is called a homogeneous Markov family. 

Proof. Let B € & s . Therefore B n X;\A) e and by definition, 

Bnx-'(A) 
£ p '(Z(?,-)^a(^,-))) 

= £ ^ ( |£l> z(j> -))l^) 

= E p *{\xbZ{s, .))E p *(-±-{xA(x(t, -))W.s) 
Z(s, •) 

(since B e ^ an d Z(s, •) is ^-measurable) 

(i) = sGx^^lM^^ .))i^,)] . . . 

Z(s, •) 

f t 
= E Q ^ B E p ^p[ J (b,dX) - X - J \b\ 2 ]xA(X(t,-)Ws)] 
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T—S l—S 

= £ & Uf B £ Pxw (exp[ J (b,dX)^ J \b\ 2 ]X A (X(t - *))] 
o o 
(by Markov property of Brownian motion) 

= E Q *(x B E Q m(x A (x(t - s))) (since — ^ = Z(t - s, •) 

dPx(s) 

= EHx B E Qx ^XA(X{t-s,-)) 

□ 142 

The result follows from definition. 

Let b : [0, oo] x R rf — > R rf be a bounded measurable function, P s x 
the probability measure corresponding to the Brownian motion starting 
at time s at the point x. Define, for t > s, 

t 

Z s , t (w) - exp[J~ (b(cr, X(cr, w)), dX(cr, w)) 



s 

t 



\b{o-,X{o-,w))\ 2 dcr] 



Exercise. (i) Z SJt is a martingale relative to P SjX ) 

(ii) Define Q\ x by Q' S JA) = j Z s , t dP s ,x, VA € 

A 

Show that Q' s x is a probability measure on ^f. 

(iii) is a consistent family. 

- /T 

function which is countably additive 



(iv) Q s ,x defined on U^ t s by Q s , x \^t = Q'sx * s a finitely additive set 



(v) The family {Q s , x : < s < oo,x e W) is an inhomogeneous 
Markov family, i.e. 

fi^m e A|J^) = S^,^, e A), Vs < tr < f, A € J?. 
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20. Brownian Motion with Drift 



[Hint: Repeat the arguments of the previous section with obvious 143 
modifications]. 

Proposition . Let t be a stopping time, t > s. Then 

Q.UX(t, •) e A|J^] = Q T ,x T ( )(X(t, •) € A) on r(w) < t, 
= XA(X(t,-)) on t(w) > t. 

Proof. Let B e & S T and B c {t < t\ so that B e J?/. 

£ G -0krBAfA(^)) = £ P "(Z,,^ A (X f )) 

= E Ps ' x [E P °HZr, t Z s , T XBXA(X t Wf)] 

(since Z satisfies the multiplicative property) 

= E P HZ s ,rXBE P HZr,tXA(X t )\^)] 

(since Z. svr is ^-measurable) 

(*) - E p -<[Z s , T X B E p ^(Z T ,x A (X t ))] 



(by strong Markov property). 
Now 

dQ s ,x 



dP s , x - . 

so that the optional stopping theorem, 



— Z st . 



dQ s 



- Z s on {t < t}, Vx. 



dP s , x ■ 

144 Putting this in (*) we get 

E Q »[X BXA {X t )] = E p »\Z^ X bE Q ^ (xaX '\ 
Observe that 

XbE Q ^(xa(X,)) 

is ^"/-measurable to conclude the first part of the proof. For part (ii) 
observe that 

x; 1 (A)n{T>t}n{T<k} 
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is in ,^ s k if k > s, so that 

x;\a) n {t > t\ e J?*. 

Therefore 

£ e "(X, e A n (r > 0)1^?) =ATA(^k{^}, 

or 

£^[(X f eA)|^]=^(X f ) if r>t. 

□ 

Proposition . Le? b : [0, oo) x M. d — > R rf fte a bounded measurable func- 
tion, f '.W 1 — > K. a«y continuous bounded function. If 

du 1 

— + - Am + x), Aw> = 0, < s < t, 
os 2 

u(t, x) = f(x) 

has a solution u, then 



u{s,x) = J f(X t )dQ StX 



Remark . b is called the drift. If b — and s - then we recover the 
result obtained earlier. With the presence of the drift term, the result is 
the same except that instead of P s x one has to use Q s x to evaluate the 
expectation. 

Proof. Let 

cr cr 

Y(cr, •) = J (b(G, X(9, •)), •)) - \ J W, X(0, -fdO. 

s s 

Step 1. (X(cr, -)-X(s, •), Y{o~, •)) is a (J+ l)-dimensional Ito process with 
parameters 

(0,0,...,0,--^(cr,X(tT,.))| 2 ) and 
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20. Brownian Motion with Drift 



d terms 



a = 



Idxd bdxl 



Ixd 



Let A - (Ai , . . . , Ad). We have to show that 



exp^F + £ \b(a, X(cr, -)\ 2 do- + (A, X(tr, •) - X(s, •)>- 



A) + 2ji{A, b + fi 2 \b(o-, -)\ 2 do-] 



is a martingale, i.e. that 

cr cr 

e X p[<i, X(tr, •) - X(s, •)> + n J (b, dX) - X - J \A + b M \ 2 dp]. 

s s 

is a martingale; in other words that 

cr cr 

s s 

is a martingale. But this is obvious because 

cr 

Z(cr, •) = f(A + nb, dX) 

s 

is a stochastic integral and hence an Ito process with parameters (0, \A + 
/*ib\ 2 ). (Refer to the section on vector-valued Ito process). 



Step 2. Put <p(o-,X(o-, •), Y(<r, •)) - u(o-,X(ct, -))e y((7v) . By Ito formula, 

did 1 
dcp = e Y —dt + e Y (Vu,dX) + ue Y dY + - ^ a fj - 



5? 

where z = (x, y), or 
_<9w 



n 2 4> 
' dztdzj ' 



dd> = e [—dt + (Vw, dX) + u(b, dX) - ^-\b\ L dt + -Vudt + (b, Vu)dt+ 
ot 2 2 
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1 9 
+-u\b\ dt] 

= e Y [(Vu,dX) + u(b,dX)]. 
Therefore (f> is an Ito process and hence a martingale. Therefore 
E(<Kt, •)) = *■)) 



u(s,x) = E p ^[(f(X(t))e 



f s (b,dx)-{ / i&prfe 
= £ G -[/(X(0)], 

which proves the theorem. 

□ 

Alternate Proof. 147 

Exercise . Let F(cr, •) be progressively measurable for cr > s. Then 
Y((r, •) is a martingale relative to {Q s , x , if and only if Y(<r)Z s>a is 
a martingale relative to (P s>x , ^D- 

Now for any function B which is progressively measurable and boun- 
ded, 



exp[ J (0,dX)-^f \8\ 2 d(T] 



is a martingale relative to (Q., P s , x ). In particular let 9 be replaced 
by 6 + b{cr, w(cr)). After some rearrangement one finds that X, is an Ito 
process with parameters b, I relative to Q sx . Therefore 



+ Vw> + ^Vu\d(T 



is a martingale relative to Q s x . But 



3m 1 

— + <6,Vw> + -Vw = 0. 

OCT 2 
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20. Brownian Motion with Drift 



Therefore 

E Q ^(u(t,X(t)) = u(s,X). 

We have defined Q sx by using the notion of the Radon-Nikodym 
derivative. We give one more relation between P and Q. 

Theorem . Let T : C([s, oo), R d ) -> C([s, oo), R d ) be given by 

t 

TX=Y where Y(t) = X(t) - J b{cr,X{o-))dcr. 

s 

(b is as before). Then 

Qs.xT — P s,x- 

148 Proof. Define Y(t, w) = X(t, Tw) where X is a Brownian motion. We 
prove that Y is a Brownian motion with respect to Q sx . Clearly Y is 
progressively measurable because T is (<^ t - ^)-measurable for every 
t, i.e. T~ l (JP t ) c & t and X is progressively measurable. Clearly Y(t, w) 
is continuous V w. We have only to show that Tfe) - Y(t\) is Q s , x - 
independent of and has distribution Af(0;fe - t\)I) for each ?2 > 
t\ > s. But we have checked that 

t 



exp[<0, X t - x) - ^\9\ 2 (t ~s)-j (0, b)da\ 



s 



is a martingale relative to Q sx . Therefore 

£ G "(exp<0, Y tl - Y H )\^ t \) = exp(^| 2 fe - h)), 

showing that Y t2 - Y t[ is independent of &f and has normal distribution 
N(0; (t2 - h)P). Thus Y is a Brownian motion relative to Q s x . Therefore 

Qs,xT — P S,X- 



□ 



21. Integral Equations 



Definition . A function b : R — > R is said to be locally Lipschitz if 149 
given any xq e R d there exists an open set Uq containing xq such that 
b\u is Lipschitz. 

Exercise 1. b is locally Lipschitz iff b\x is Lipschitz for every compact 
set K i.e. iff b\x is Lipschitz for every closed sphere K. 

Exercise 2. Every locally Lipschitz function is continuous. 

Theorem . Let b : W 1 R d be locally Lipschitz and X : [0, oo) R d 
continuous. Then 

(i) the equation 



has a continuous solution near 0, i.e. there exists an e > and a 
continuous function Y : [0, e] — > R d such that the above equation 
is satisfied for all t in [0, e], 

(ii) (Uniqueness) IfY\, Y>i are continuous solutions of the above equa- 
tion in [0, T], then 



Proof, (ii) (Uniqueness) Let f(f) - \Yi(t) - Y 2 (t)\. As Fi, Y 2 are con- 
tinuous, there exists a k > such that 1*2(01 ^ k for all t in 




o 



Fi = y 2 on [0,7]. 
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21. Integral Equations 



[0, T]. Choose C such that \b(x) - b(y)\ < C\x - y\ for \x\, \y\ < k and 

150 C sup /(/). Then f(t) < C and f(t) <Cj f(s)ds so that f(t) < ^ for 
o<?<r o 
all n - 1, 2, 3, . . .. Thus Y\{t) - proving uniqueness. 

(i) (Existence) We can very well assume that X(0) - 0. Let a - 
mf[t : \X(t)\ > 1}, 

M > sup{\b{x)\ : \x\ < 2}, a - infja, -j^}, 

C + 0, a Lipschitz constant, so that \b(x) - b(y)\ < C\x - y\ for all \x\, 
\y\ < 2. Define the iterations Yo, Y\, . . . by 

Y Q (t) - X(t), Y n+l (t) - X(t) + J b{Y n {s))ds 



for all t > 0. By induction, each Y n is continuous. By induction again, 
\Y n {t) - X(t)\ < Mt for all n, < t < a. Again, by induction \Y n+l (t) - 
Y nV)\ ^ fpjj for < ? < a. Again, by induciton \Y n+1 (t) - Y n (t)\ < 

T(n+W f° r ^ - t - a - Thus Y n {f) converges uniformly on [0, a] to a 
continuous function Y{t) which is seen to satisfy the integral equation. 



Remark . Let X : [-6, 00) — > E. d be continuous where 8 > 0. Then a 
similar proof guarantees that the equation (*) has a solution in [-e, e] 
for some e > 0. 

Define B(X) = sup{? : (*) has a solution in [0, t]}. The theorem 
above implies that < B(X) < 00. B(X) is called the exploding time. 

Remark . If b is, in addition, either bounded or globally Lipschitz, 
B(X) = 00 for every continuous X : [0, 00) — > R d . 

151 Example. Let b(y) = y 2 , X(t) - 0. The equation 

Y(t) = x + J b(y(s))ds 
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with xq > has a solution 



Y(t) = - J— , Vf < 

j--t x 

the solution explodes att - x Q l . 
Proposition . If 

B(w) < oo, then Lt \y(t)\ - +00. 

t\B(w) 

Proof. Suppose that lim |j| = R < 00. Let (t n ) be a sequence increas- 

t^>B(w) 

ing to B(w) such that \y(t n )\ < R + 1, Vn. Let 

T n = M{t>t n :\y(t)-y(- n )\>l}. 

Then 

l = Ij(t„) - y(t n )\ 
< w{T n ) - w(t n )\ + (t„ - t n ) sup \b(A)\ . . . , (1) 

Since (t n ) is bounded, we can choose a constant M such that 

\w{t n ) - w(t)\ < l - if \t- t n \ < M. 
Then using (1), 

t„ - > inf {M, (2 sup \b(A)\T x where /I € S (Y(t n ); 1) 
Therefore 

r n - t n > inf (M, (2 sup \b(A)\y\ A e 5 (0; R + 2)) = a(say)V «. 

152 
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21. Integral Equations 



Chose n such that t„ > B(w) > t n . Then y is bounded in [t n , B(w)] 
and hence it is bounded in [0, B(w)). From the equation 

t 

y(t) = X(t) + J b(y{s))ds 
o 

one then gets that Lt y(t) exists. But this is clearly a contradiction 

since in such a case the solution exists in [0, B(w) + e) for suitable e, 
contradicting the definition of B(w). Thus 

lim \y(t)\ = +oo 



and hence 



lim \y(t)\ = +oo. 



Corollary .Ifbis locally Lipschitz and bounded, then B(X) = oofar all 
X in C([0, oo), R d ). 

Proof. Left as an exercise. □ 

Proposition . Let b : R rf — > R d be locally Lipschitz and bounded. Define 
T : C([0, oo), R d ) -> C([0, oo), R d ) by TX = Y where 

t 

Y(t) - X(t) + J b{Y{s))ds. 
o 

Then T is continuous. 

Proof. Let X, X* : [0, oo) -> R d be continuous, K > be given. 
Let Y , Y\, . . . , Y*, Y*, . . . be the iterations for X, X* respectively. Then 
\Y n (t) - X(t)\ < KM*, for < t < K, n = 0, 1,2,3, . . ., so that we can 
find R such that \Y n (t)\, Y*(t)\ < R for < t < k, n = 0, 1,2, . . ., Let 
C > 1 be any Lipschitz constant for the function b on \x\ < R. Then 

(Ct) 2 

\Y n (t) - Y* n (t)\ < sup \X(t) - X\t)\ ■{\ + Ct+ + 

0<t<K l - 
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(CO" 

+ --- + ^-) for 0<t<K, n = 0,1,2,3,.... 
«! 

A b is bounded, F„ converges uniformly to Y on [0,.K]. Letting 
n — > oo, we get 

sup - < e c * sup |X(r) - X\t)\, ... (2) 

0</<7sT 

where c depends on sup \X{t)\, sup The proof follows by (2). 

0<t<K 0<t<K 

□ 



22. Large Deviations 



LET P € BE THE Brownian motion starting from zero scaled to Brown- 

A 

ian motion corresponding to the operator e— . More precisely, let 



where P is the Brownian motion starting at time at the point 0. 

Interpretation 1. Let {X t : t > 0} be Brownian motion with X(0) - x. 
Let 7(f) = X(et), Vf > 0. Then P £ is the measure induced by the process 
Y(t). This amounts to stretching the time or scaling time. 

Interpretation 2. Let Y(t, •) = ^eX{t, •). In this case also P £ is the 
measure induced by the process Y(t, •)• This amounts to 'looking at the 
process from a distance' or scaling the length. 

Exercise. Make the interpretations given above precise. 

(Hint: Calculate (i) the probability that X(et) e A, and (ii) the probability 

that y]eX(t, ) € A). 

Problem. Let 



o 

if w(0) = 0, w absolutely continuous on [0, 1]. Put I(w) = oo otherwise. 



2 
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22. Large Deviations 



We would like to evaluate 



e~dP £ {w) 



n 



for small values of e. Here F(w) : C[0, 1] — > R. is assumed to the a 
bounded and continuous function. 

Theorem . Let C be any closed set in C[0, 1] and let G be any open set 



liminf e\ogP e {G) > - inf I(w). 

Here P e (G) = P £ (n~ l G) where n : C[0, oo) C[0, 1] is the canoni- 
cal projection. 

Significance of the theorem . If 
1. 



in C[0, 1]. Then 




dP £ = e ' , 



then 




A 



is asymptotically equivalent to 



exp[ — inf I(w)]. 



€ weA 



2. If A is any set such that 



inf I(w) = inf I(w), 

weA w eA 



then by the theorem 



e->0 weA 



Lt log P £ (A) = inf I(w). 
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Proof of the theorem. 

Lemma 1. Let wq e Q with I(wq) = I < oo. If S - S(wq;6) is any 
sphere of radius 5 with centre at wq then lim e log P £ (S) > -I(wq). 



Proof 



P(S) 



= fy (w) 



_ r (w-wo).p 

J <*S(0;) 



= J Xs{0-s){^w)dP , where A{w) - w - w Q , 
= J Xs(0-5){^ew))dP{w) 



= J *S(0,<5)(Vew) ex P 



1 1 
J ( W0 ,dX)-^f \w Q \ 2 dcr 



dP(w) 



1 

J (wo, 



dX) - 7(w ) 



dP(w) 



dP e (w) 



-I(w ) 

= e—P £ (S(0;6)) 



4 J <w ,^>-i/(w ) 



L_ Jexp-IJ(vvo,^) 



^(5(0 



S(0;<S) 



dP f 



-/(Wq) 

> ,P e (5(0;5))e 



1 1 



eP £ (S(0;S)) 



1 

J J(w ,dX)dP e 



S(0;<5) 



by Jensen's inequality, 



- ; ("'o> 

- e~ P £ (S(0,6))e°(use P £ (w) = P e (-w) if we S(0;5)) 



= e—P £ (S(0,6)). 
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22. Large Deviations 



157 

Therefore 

P £ (S(w ;5))>e^P(S(0; 

or, 

elogP £ (S(w Q ;5)) > -I(w Q ) + elog/>(S(0; ^-)); 

let e — > to get the result. Note that the Lemma is trivially satisfied if 
I(wq) = +oo. □ 

Proof of Part 2 of the theorem. 

Let G be open, wo € G; then there exists 8 > with S(wo, 6) c G. 
By Lemmaffl 

Urn e log P e (G) > lim e log P e (5(w ; <5)) > -7(w ). 

e->0 e^O 

Since wo is arbitrary, we get 

lim € logP e (G) > -inf{/(w ) : w e G). 

For part 1 we need some more preliminaries. 

Lemma 2. Let (w n ) e C[0, 1] be such that w n — > w uniformly on [0, 1], 
7(w„) < a < oo. 772e« 7(w) < a, /.e I is lower semi-continuous. 

Proof. 

Step 1. w is absolutely continuous. Let {(x' p *")}" =1 be a collection of 
mutually disjoint intervals in [0, 1]. Then 

x" 

n n !-. 

2 - ^ Z - ^ |1/2[ I |vvm|2]1/2 

(by Holder's inequality) 
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A,. 

n L 



1/2 



W„ 



2 |X " " ^1 



\l/2 



V ;=1 



(again by Holder) 



V(2a)(2>;'-*;i) 1/2 . 



Letting m->oowe get the result. 
Step 2. Observe that w m (0) = 0S w(0) = 0. Therefore 



w n (x + h) - w n (x) a ,1 



\dt 



x+h 



dt. 



Hence 

l-h 



l-h h 



I I ^ 1 < ^ I <*c I + 0)1 dt 







,(x + 01 dx 



letting n — > oo, we get 



+ h) - w(x) 2 



dx < 2a. 
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Let /i — > to get I(w) < a, completing the proof. 
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22. Large Deviations 



□ 

159 Lemma 3. Let C be closed and put C s - \J S(w; 8); then 

weC 

lim( inf I(w)) = inf I(w). 

<S-»0 w eC s weC 

Proof. If 6\ < 62, then C Sl c C &1 so that inf I(w) is decreasing. As 
C 5 DC for each 5, 

lim( inf /(w)) < inf I(w) 

5^0 weC 6 weC 

Let I = lim( inf /(w)). Then there exists wg e C s such that I(wg) — > 
^, and therefore (/(w^)) is a bounded set bounded by a (say). 

Claim. 

\w s (h) - w 6 (t 2 )\ = I f w 6 dt\ < VKki - t 2 \)( f \w 6 \ 2 ) 1/2 



< V(2a|?i - ? 2 |). 

The family (wg) is therefore equicontinuous which, in view of the 
fact that ws(0) = 0, implies that it is uniformly bounded and the claim 
follows from Ascoli's theorem. Hence every subfamily of (wg) is equi- 
continuous. By Ascoli's theorem there exists a sequence 5 n — > such 
that w6 n — > w uniformly on [0,1]. It is clear that w e C. By lower 
semicontinuity of I(w), 

lim inf I(w) > inf 

(5-»0 weC 5 weC 

completing the proof. 

□ 

160 Proof of Part 1 of the theorem. Let X be continuous in [0, 1]. For each 
n let X n be a piecewise linear version of X based on n equal intervals, i.e. 



X n is a polygonal function joining the points (0, X(0)), {I In, X(\/n)), . . . , 
(1,X(1)). 



Pe(||X B - ^11 > <5), (II • II = II • llco) 



I J sup • sup \X r (t)-X r U |>r-r^ , 

where X = (X u . . . ,X d ). 
6 

< ndP e { sup \X(t) - X(0)\ > —j- (Markov property; here X is one- 
dimensional). 

< ndP e sup |X f | > (since X(0) = 0) 

V0<f<l/n 2^d) 

< 2nd P e { sup X, > 

0<t<l/n z V a 

= 2dn P{ sup X, > -4-t) 

0<f<l/n ZV^a 

= 4<ira P(X(l/«) > — ; — ) (by the reflection principle) 

CO 

= Adn f —}—e- n y 2/2 dy 
J ^2njn 

oo 

= 4d f -Le-* 2 ' 2 dx 
J ^2n 

Now, for every a > 0, 



a J" e r 2 dx < J : = e 



Thus 



168 



22, Large Deviations 



Pe(l|X „_ X|l ^ s ^^ = ClW ^-^, 

where C\ depends only on n. We have now 

P £ {X n e C s ) < P e (I(X„) > h) where 4 = inf{/(w)w e C s ). 

n-l \ 

- P 



7=0 v ' 



= P^ + Yl + ... + Yl d > 1 J±) j , 

where Yi - ^n(X\(l/n) - X\(0)) etc. are independent normal random 
variables with mean and variance 1. Therefore, 

P(Y 2 [+ ... + Y 2 nd >^) 



= C(„> J 



V(24/e) 

using polar coordinates, i.e. 



Pi Y 2 + Y 2 2+ ... + Y 2 d >^) = C'(n) J 

(tale) 



-S 22-1 r 



(change the variable from r to s = — ). An integration by parts gives 



oo 

f 



e- s s k ds = <T<V + 



kl 



a k - 2 + -..). 



(k-iy. 



Using this estimate (for n even) we get 

P((Y 2 + • • • + F„ 2 d ) > ^) < C 2 ( W )e-^^(^)T-i, 
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where C 2 depends only on n. Thus, 

P £ (C) < P e (\\X n - X\\ >6) + P £ (X n t C s ) 



nd _ 1 
2 1 



< Cl (n^^e~ n62 ^ + C 2 {n)e' e ^iyj 

na y 

< 2m a x[Cm^(f)e- n52/{ * ed \C 2 {n)e^ /£ ^ ' 
e logP £ (C) < 6log2 + emax[log(Ci(n)V(^) 



e -n6 2 /(8ed) 



logC 2 (n)e-^ £ fi) S T- [ ] 

€ 



Let e — > to get 



-nS 2 -€ s 
lim € log P e (C) < max { ——, 



Sd 1 

Fix 6 and let n — > 00 through even values to get 

lim e log P e (C) < -4. 
Now let 5 — > and use the previous lemma to get 

lim € log P £ (C) < - f I(w). 

weC 

Proposition . Let I be finite; then {w : I(w) < £} is compact in Q,. 
Proof. Let (w n ) be any sequence, I(w n ) < I. Then 

\Wnih) ~ W n (t 2 )\ < V(^kl - t 2 \) 

and since w„(0) = 0, we conclude that {w n } is equicontinuous and uni- 
formly bounded. □ 

Assumptions. Let Q. be any separable metric space, & = Borel tr-field 
on Q. For every e > let P £ be a probability measure. Let / : Q — > 
[0, 00] be any function such that 
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(i) / is lower semi-continuous. 

(ii) V finite t, {w : I(w) < 1} is compact. 

(iii) For every closed set C in Q., 

lim sup e log P £ (C) < - inf I(w). 

e^O weC 

(iv) For every open set G in Q 

lim inf € log P £ (G) > - inf I(w). 

e^O weG 

Remark. Let Q. = C[0, 1], P e the Brownian measure corresponding to 

1 i 

the scaling e. If I(w) - — J \w\ 2 dt if w(0) - and oo otherwise, then all 

2 o 

the above assumptions are satisfied. 

Theorem . Let F : Q, — > R Z?e bounded and continuous. Under the 
above assumptions the following results hold. 

(i) For every closed set C in Q. 

r f(w) 

lim sup e log exp dP £ < sup(F(w) - I(w)). 

e->0 J f w€C 

c 



(ii) For every ope« set G in Q. 

r f(w) 

lim inf € log I exp dP e > sup(F(w) - I(w)). 

G 

/« particular, ifG = Q. = C, then 

r f(w) 

lim e log I exp dP e = sup(F(w) - I(w)). 

J e wen 

n 
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Proof. Let G be open, wq e G. Let 8 — > be given. Then there exists a 
neighbourhood TV of wo, F(w) > F{wq) - 8, Vw in N. Therefore 

C F(w) C F(w) E^otl 

I exp ——^dP £ > I exp ——^dP £ > e^^P e {N). 



Therefore 



r f(w) 

elog I exp ——-dP £ > F(w ) - 8 + 6 log P e (A0- 

G 



Thus 



limlog ^ 



F(w) 

exp ——dP £ > F(w ) - 8 + lime log P £ {N). 



> F(wo) - 8 - inf I(w) > F(wq) - I(wq) - 8. 
Since 8 and wq are arbitrary (wq e G) we get 



lim e log ^ 



F{w) 

exp dP e > sup(F(w) - I{w)). 

£ weG 
G 



This proves Part (ii) of the theorem. □ 
Proof of Part (i). 

Step 1. Let C be compact; L = sup(F(w) - I(w)). If L - -oo it follows 

weG 

easily that 



lim sup elog I e F/£ dP £ <-oo. 



c 

(Use the fact that F is bounded). Thus without any loss, we may assume 
L to be finite. Let wq e C; then there exists a neighbourhood N of wq 
such that F(w) < F(wq) + £ and by lower semi-continuity of /, 

I(w) > I(w ) -8, Vvce N(w ). 
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22, Large Deviations 



By regularity, there exists an open set G WQ containing wq such that 
G Wo G Wo N(wo). Therefore 

f F(w) ( F(w ) + 6 \ n - 
I exp ——dP e exp I I P £ (G Wo ). 



Therefore 

r f(w) — - 

lim sup € log exp dP £ < F(wq) + 5 + e lim P £ (G WQ ) 

G WQ 

< F{wq) + 5- inf I(w) 

weG WQ 

F(wq) + 6 - /(wo) + 6 
<L + 25. 

Let K( = {w : I(w) < t). By assumption, K{ is compact. Therefore, 
for each 5 > 0, there exists an open set G$ containing Kf n C such that 

/ F(w) 
e f <iP e < L + 25. 



Therefore 



e f <iP e < L + 26, 

G s nc 

J e^dP £ <e M,£ P(CnG^). 

G'nC 



Therefore 



/ F(w) 
e < dP £ < M + lim sup £ log P e (C* n C) 



< M - inf /(w). 



weCnG£ 
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166 Now 

Therefore 



G c s c K c e n C c . 



CnG c s cCnK c t 



ifweCn G c s , w £ K e . Therefore I(w) > t. Thus 

lim sup € log f e F(w)/£ dP e <M-€<L<L + 26. 

G^nc 

This proves that 

r f(w) 

lim sup e log exp dP e < L + 26. 

e->0 J £ 

c 

Since C is compact there exists a finite number of points w\,...,w n 
in C such that 



CcQg h 



(=1 

Therefore 



lim c-: log J exp < lime log j e tW)lt dP, 



F(w)/e, 



e 



C 



— r 

< lim(e log n Max exp ciP e ) 

i<;< J e 

G M ,, 

< L + 26. 

Since 5 is arbitrary. 

— P F ( w ) 

lim € log I exp ciP e < sup(F(w) - /(w)). 

c 

The above proof shows that given a compact set C, and 5 > there 167 
exists an open set G containing C such that 

— P 

lim e log exp ——-dP e < L + 26. 

G 
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22. Large Deviations 



Step 2. Let C be any arbitrary closed set in Q. Let 

L = sup(F(w) - I(w)). 

weC 

Since F is bounded there exists an M such that \F(w)\ < M for all 
w. Choose I so large that M - I < L. Since 8 is arbitrary 

lim sup € log I exp dP £ < sup(F(w) - l(yv)) 

c 

We now prove the above theorem when P £ is replaced by Q x . Let 
P e x be the Brownian motion starting at time t = at the space point x 
corresponding to the scaling e. Precisely stated, if 



t £ : C([0,coy,M. d ) ^ C([0,co);E. d ) 

and T £ is given by 



is the map given by (T £ w)(t) = w(et), then P x -P x t £ 1 . Note T''t £ - T £ 

def 



T £ w = y where y(t) = w(et) + J~ b(y(s))ds. 

o 

Hence 

PJ- X = P x {Ti,T £ y x = P x r- £ X T- 1 = P X T~ [ ; 

either of these probability measures is denoted by Q x . 

Theorem . Let b : R d — > R d be bounded measurable and locally Lips- 
chitz. Define 

l 

/(»•) : - I |X(r)-6(X(r))| 2 <fc 



o 



If w £ C([0, oo); R d ), w(0) - x and x absolutely continuous. Put 
I(w) = oo otherwise. If C is closed in C[(0, 1]; R rf ), 



lim e log <2*(C) < - inf I(w). 

e->0 weC 



IfG is open in C([0, 1]; R d ), then 



lim € log Q e x (G) > - inf I(w). 
e->0 ' weG 

A* msmc?/ <2*(C) - Q^/r~ (C) where 

n : C([0,oo);R rf ) -> C([0, 1];R J ) 

jj ?/2e canonical projection. 

Remark. If b = we have the previous case. 

Proof. Let T be the map x(-) — > y(-) where 

t 

y(t) = x(t) + J b(y(s))ds. 
o 

Then 

If C is closed 

G£(C) = P x (T~ l C). 
The map T is continuous. Therefore T' l {C) is closed. Thus 

lim sup € log Q X (C) = lim sup e log P x (T~ l C) 

e— »0 " e— »0 

1 

<- inf - I \X\ 2 dt (see Exercise fflbelow) 

(*\ wer-'(C) 2 J 

V 7 

1 

= -inf- f |r _1 w| 2 *. 

wed J 


Now 

y(-) ^ - f %(*))^. 
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Therefore 

(T~ l y) - y - b(y(s)). 

Therefore 

lim sup e log Q X (C) < - inf I(w). 

e-»0 weC 

The proof when G is one is similar. □ 

Exercise 1. Replace P e by P% and / by I x where 
l 

h{w) - ^ J"l w l 2 ' = jc,w absolutely continuous, 
o 

- oo otherwise. 
Check that (*) holds, i.e. 

lim sup e log P X (C) < - inf I x (w), if C is closed, 

e-»0 " weC 



and 



lim inf e log P X (G) > - inf I x (w). 

e-»0 weG 



Let G be a bounded open set in R", with a smooth boundary T = dG. 
Let b : R d R d be a smooth C°° function such that 

(i) (b(x), n(x))0, Vx e dG where n(x) is the unit inward normal. 

(ii) there exists a point xq € G with Z?(*o) = an d |^(x)| > 0, Vx in 
G - {x }. 

(iii) for any x in G the solution 

t 

= J b{Z(s))ds, 


of the vector field starting from x converges to xq as t — > +oo. 
Remark, (a) (iii) is usually interpreted by saying that "xq is stable". 
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(b) By (i) and (ii) every solution of (iii) takes all its values in G and 
ultimately stays close to xq. 
Let e > be given; / : dG — > R be any continuous bounded func- 
tion. Consider the system 

L e u e - ^Aw e + b(x) ■ Au £ - in G 
u e - f on dG. 

We want to study lim u e {x). Define 

e-»0 
T 

= \f \X(t) ~ HX(t))\ 2 dt; X : [0, T] -» R rf 

o 

whenever X is absolutely continuous, = oo otherwise. 

Remark. Any solution of (iii) is called an integral curve. For any curve 
X on [0, T], Iq gives a measure of the deviation of X from being an 
integral curve. Let 

V T (x,y) = inf{/ r (X) : X(0) = x; X(T) = y\ 

and 

V(x,y) = M{V T (x,y):T > 0}. 
V has the following properties. 

(i) V(*,30< V(x,z) + y(z,v)Vx,v,z. 

(ii) Given any x, 35 —> and C > such that for all y with |jc - y| < 5. 

V(x,y)<C\x-y\ 

t(y - x) 

Proof. Let X(t) = -f- f + jc. 

ly - A 

Put 



r = |y - jc|, X(0) - x, X(T) = y, 
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y —±-b(X+^(y- x)) 



ds. 



Then 



-J- 



\y - 4 

T 2 



+ \\b\t\ds, 
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where 



\\b\l 



sup b(A), 

\A-x\<\y-x\ 



or, 



/q < (1 + \\b\t)\y - x\. 
As a consequence of (ii) we conclude that 



V(x,y)< 



1 + sup \b(A)\ 2 

\A-x<\y-x\ 



\y - A, 



i.e. V is locally Lipschitz. 

The answer to the problem raised is given by the following. 



Theorem 



lim u £ (x) = f(y ) 

6^0 



where yo is assumed to be such that y$ e dG and 

V(x ,y ) < V(x,y), Vy edG,y± y . 



We first proceed to get an equivalent statement of the theorem. Let 
P £ x be the Brownian measure corresponding to the starting point x, and 
corresponding to the scaling e. Then there exists a probability measure 
Q% such that 



dP% 



&t = Z(t) 
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where 

t t 
Z(t,-) = exp J (b*(X(s)), dX(s)) - X - J b*(X(s))ds; 



b* is any bounded smooth function such that b* - b on G. Further we 
have the integral representation 



Ue(x) = J f(X(T))dQ 

dG 



where r is the exit time of G, i.e. 

t(w) = inf{? : w(f) i G\. 
\u € (x) - f(y )\ = I J (f(X( T )) - f(y ))dQ 

dG 

<\ J (f(X(T))-f(Y ))dQ £ x \+ 

NndG 



+1 (f(X(T)) - f(Y ))dQ[ 



N c ndG 

(N is any neighbourhood of vo)- 
<Ql(X(r)eNndG) sup \f(A)-f(y )\+ 

AeNndG 

+2\\f\\ co Q £ x (X(T)eN c ndG). 
Since / is continuous, to prove the theorem it is sufficient to prove 



the 

Theorem 



lim Q x (X(t) €N c ndG) = 

e->0 



for every neighbourhood N of vo- 
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Let N be any neighbourhood of yo. Let 

V = V(xo,y ),V = inf V(x,y). 

y<EN c ndG 

By definition of yo and the fact that N c (~)dG is compact, we conclude 
that V > V. Choose 77 = rj(N) > such that V - V + 77. For any 5 > 
let D - S(x ; <5) = {y : |y - *ol < 6], 3D = [y:\y- x Q \ = 6}. 

Claim. We can choose a 62 such that 

(i) V(x,y) > V + Vx € 3D 2 , y € N c 5G. 

(ii) V(x,jo)< V+^,VxedD 2 . 

Proo/ (i) V(x ,y) >V + n,VyeN c dG. Therefore 

V + 7] < V(x ,y) < V(x , x) + V(x,y) 
<C\x-x \ + V(x,y). 

77 

Choose C such that C\x - xq\ < —. Thus 

V + ^ < if C|x - x | < ^, e N c 3G. 

C depends only on xo- This proves (i). 

77 

(ii) \V(xo,yo) - V{x,yo)\ < V{xo, x) < C\xq -x\ < - if xis close to xq. 
Thus 

V(x,y )< V(x ,yo) + l = V+^ 

if x is close to X(>. This can be achieved by choosing 62 very small. 

□ 

Claim (iii) We can choose 6\ < 62 such that for points x\, X2 in dD\ 
there is a path Z(-) joining x\, x 2 with X(-) e D 2 - D\, i.e. it never 
penetrates D\ \ and 

I(X) < -. 
v ' 8 
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Proof. Let C = sup{|6(/l)| 2 : \A - x \ < S 2 \. Choose X(-) to be any path 
on [0, T], taking values in D 2 with X(0) - x\\ X(T) - x 2 and such that 
\X\ - 1 (i.e. the path has unit speed). Then 



((I) < J (\X\ 2 + C)dt <CT + J \X\dt 


= (c + i)r = (c + i)|x 2 -xil. 

j] 

Choose 5\ small such that (C + \)\x 2 - x\\< -. 

_ 8 

Let = {w : w(t) e G - D^Vt > 0}, i.e. Q5i consists of all 
trajectories in G that avoid D\. □ 



Claim (iv) 



inf inf /„(*(•)) > V + ^? 

r>0 Xen 5l ,X(0)e<5D 2 4 

eN c ndG 



Proof. Follows from Claim (i) and (ii). □ 
Claim (v) 

inf inf /„(*(•)) <V + ^-. 

T>0XeCl Sv X(0)edD 2 U 8 
X(T)=y a 

Proof. By (ii) V(x,y ) < V + ^Vx e dD 2 , i.e. 



inf inf < V+ ?. 

r>ox(0)=^z(r)=y 4 



Let e > be arbitrary. Choose T and X(-) such that V^X) < V + 1 +e 

with X(0) = x, - y , X(-) eG.JfXe Q 6l define Y = X.IfX £ Q 6l 
define F as follows: 
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Let ti be the first time that X enters D\ and t 2 the last time that it 
gets out of D\. Then < t\ < t 2 < T. Let X* be a path on [0, s] such 
that (by Claim (hi)) I S Q (X*) < | with X*(0) = X(h) and X*(s) = X(t 2 ). 
Define Y on [0, T-(t z - h) + s][T - (t 2 - h) + s, oo) by 

K(f) - X(0 on [0, h]=X*(t-h) on fa, ^ + s] 
- X(t - ti - s + ti), on [ti + s,T - fe - *i) + 
= Xfe), for?> r-(/ 2 -fi) + j. 

Then 



.v 



+- I - /)(I(s))| 2 (Ij 



4/- 



(2 

< V+ ? +6+ ? 

4 8 

by choice of X and X*. As F e , we have shown that 
inf inf il (X(-)) <V+^- + e. 

T>0Xen 6l ,X(Q)edD l 8 
X(T)=y 

Since e is arbitrary we have proved (v). □ 

Lemma . Iq is lower semi-continuous for every finite T. 

Proof. This is left as an exercise as it involves a repetiti on of an argu- 
ment used earlier. □ 

Lemma . Let X„ e Q^. If T n — > oo then I^ n (X n ) — > oo. 

This result says that we cannot have a trajectory which starts outside 
of a deleted ball for which / remains finite for arbitrary long lengths of 
time. 
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Proof. Assume the contrary. Then there exists a constant M such that 
iI"(Xq) < M, Vn. Let T < oo, so that M T = sup I%(X„) < oo. 

n 

Define X T n -X n \ [0tT] . □ 

Claim. {X„} n= i is an equicontinuous family. 
Proof. 

\X T n (x 2 )-X T n ( Xi )\ 2 = \ j Xl{t)dt\ 2 

X\ 

2 I \vT\l, 



<\x 2 -x,\ l \X l Sdt 



x\ 

X2 



< 2\x 2 - x,\ 2 J \X T n - b(X T n )\ 2 ds + J b{X T n ) 2 ds\ 



<2\x 2 - Xi \ 2 [2M T + T\\b\\il 

Thus, {X T n \ n is an equicontinuous family. Since G is bounded, 
is uniformly bounded. By Arzela-Ascoli theorem and a "diagonal pro- 
cedure" there exists a subsequence X ni and a continuous function to X 
uniformly on compact subsets of [0, oo). As X nk {-) € G-D\,X e G-D\. 
Let m> n. lI"(X m ) < M. X n — > X uniformly on [0, T n ]. By lower semi- 
continuity Iq(X) < M. Since this is true for every T we get on letting T 
tend to oo, that 



\X - b{X{s))\ 2 ds < M. 



o 

Thus we can find a sequence a\ <b\ < a 2 <b 2 < ... such that 

b„ 

= \ J \X(t) - b{X{t))\ 2 dt 
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converges to zero with b„ - a n — > oo. Let Y n (t) = X(t + a n ). Then 

I b Q~ a "(Y n ) -> with b n - a„ -> +oc, Y n € Q. 8 , . 

178 Just as X was constructed from X n , we can construct Y from Y n such 

that Y n — > F uniformly on compact subsets of [0, oo). 

A-^(y) < inf t n ~ a \Y m ) = 

u «i>« u 

(by lower semi-confirmity of Iq ). Thus 7g" _a "(7) = 0, V«, showing that 



f 



Y(t) - b(Y(t))\ 2 dt - 



Thus Y satisfies F(-) = x + f b(Y(s))ds with F(0 eG-dD u Vt. 

o 

Case (i). F(?o) e G for some ? . Let Z(f) = F(?+?o) so that Z is an integral 
curve starting at a point of G and remaining away from D\ contradicting 
the stability condition. 

Case (ii). Y(t ) <£ G for any to, i.e. Y(t) € dG for all t. Since Y(t) - 
b(Y(t)){Y(t), n(Y(t))) is strictly positive. But Y(t) e dG and hence 
(Y(t),n(Y(t))) - which leads to a contradiction. Thus our assump- 
tion is incorrect and hence the lemma follows. □ 

Lemma . Let x e 8D2 and define 

E = {X(t) exits from G before hitting D[ and it exits from N\ 
F = {X(t) exists from G before hitting D\ and it exits from N c ] 

Then 



Q £ X (E) 



< exp I -- — l- 1 — 11 — > uniformly in x(x € dDi). 



179 Significance. Q X (E) and Q X (F) are both small because diffusion is small 
and the drift is large. The lemma says that Q X (E) is relatively much 
larger than Q X {F). 
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Proof. Q X {E) > Q e x {X(t) exists from G before hitting D\, and exists in 

1 T 

N before time T), - Q X {B) > exp[ — inf (X(-))] where the infimum 

e u 

is taken over the interior of B, 



> exp 



1 



377 



_ +0 - 



Similarly, 



Q e x (F) < exp 



-I V+^|4 01- 



Therefore 



< exp 



3?7 Jl 



as 



We now proceed to prove the main theorem. Let 



TO -0, 

Ti = first time <9Di is hit, 
T2 = next time dDi is hit, 
T3 = next time dD\ is hit, 



and so on. Observe that the particle can get out of G only between the 
time intervals T2„ and T2 n +i- Let E n - {between T2„ and T2„+i the path 
exits from G for the first time and that it exits in N), F n = {between Tm 180 
and T2„ + i the path exits from G for the first time and that it exists in N c }. 



Also 



Q £ x (X(t) e N) + Q x (X(t) e N c ) = 1. 

CO 

Q € x (X(t) e AO = £ Q*(F„), 

n=l 

oo 



n=l 
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J]Q £ x (Fn) = J]E®(Ql(F n \3r T J) 



n=l n=l 

X 1 ne _ 

< 



^E Q *\x(T>T 2n ) sup Q £ X (F)] (by the Strong Markov property) 
< 0(6) 2 E®\x (T>T2n) M QUE)] (as -> 0) 

oo 

< 0(e) ^ G^„) = 0(6)G J (X(r) € AO- 

n=\ 

Therefore 

e^Ot(r) e AO -» 1 , Q,(X(t) e AT C ) -» 0. 



Exercise. Suppose &(jc) = Vm(jc) for some u € C l (G U dG,R). Assume 
that u(xo) - and u(x) < for x + xq. Show that 

V(x ,y) = -2u(y). 
[Hint: For any trajectory X with X(0) - xq, 

T T 

X(T) = y, I*(X) = jj \X + Vu(X)\ 2 dt -2 J Vu(X) ■ X(t)dt > -2u(y) 



so that V(xQ,y) > -2u(y). For the other inequality, let u be a solution of 

X{t) + Vu(X(t) - on [0, oo) with X(0) = y. Show that because — -^0 

as 

for X(s) + and xo is the only zero of u, limitX(?) = xq. Now conclude 

t— »oo 

that V(xo,y) < -u(y)]. 



23. Stochastic Integral for a 
Wider Class of Functions 



WE SHALL NOW define the stochastic integral for a wider class of 
functions. 

Let : [0, ) x Q. — > R d be any progressively measurable function 
such that for every t 



I 



\6(s,w)\ ds < oo, a.e. 



Define, for every finite L > 0, 



8 L (s, w) = ■ 



9(s,w), if j \9(t,w)\ 2 dt < L < oo, 
o 

s 

0, if / \6(t, w)\ 2 dt > L. 

o 



We can write 6l(s, w) - 6{s, w)x[o,L)(<P(^, w)) where 



4>(s, w) = J \6(t, 
o 



wfdt 



is progressively measurable. Hence 9l(s, w) is progressively measur- 
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23. Stochastic Integral for a Wider Class of Functions 



able. It is clear that J \6l(s, w)\ 2 ds < L, a.e. V7\ Therefore 



i 

/•-'(J I"/. ■ < L. 


t 

Thus the stochastic integral ^{t, w) - J(6l(s, w), dX(s, w)) is well de- 



fined. 

The proofs of the next three lemmas follow closely the treatment of 
Stochastic integration given earlier. 

Lemma 1. Let r be a bounded, progressively measurable, continuous 

function. Let t be any finite stopping time. If 6{s,w) = 0, V(s,w) such 

t 

that < s < t{w) then J (9(s, w), dX(s, w)) = Ofor < t < t(w). 
o 

Proof. Define 9 n (s,w) = 9(^f-,w). 6 n is progressively measurable and 
by definition of the stochastic integral of 9 n , 



J (9 n (s, w), 



dX{s,w)) = 0, Vf, 0<t<T(w). 



Now 



e\J \9 n (s, 

-Am 



w) - 9(s, w)\ 2 ds 



w\- 9(s, w)\ z ds 



as n — > oo 



and 



J (9 n (s,w),dX(s,w)) ^ J (9(s,w),dX(s,w)) 
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in probability. Therefore 



dX) = Oif < t < t(w). 



□ 



Lemma 2. If 6 is progressively measurable and bounded the assertion 
of Lemma\J]still holds. 



Proof. Let 



Then 



%{t, w) = - f 9(s, w)ds. 
n J 

<j-mvo 



e\J \6 n (t,w) - 9(t,w)\ 2 dt 



(Lebesgue's theorem). 



n is continuous and boundd, n (t, w) = for < t < t(w). By lemma[2 

r 

J (9 n (s,w),dX(s,w)) - 
o 

if < t < t{w). This proves the result. □ 
Lemma 3. Let 9 be progressively measurable such that, for all t, 



t t 



J \9(s, 



w)\ 2 ds 



vo 



< oo. 



If9(s, w) = Ofor < s < t(w), then 



dX(s, w)) = for 0<t< t(w). 
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Proof. Define 

Q [e, M\e\<n, 

" (0, if \0\ > n. 

Then 

c 

J <0„, dX) = 0, if < t < t(w), (LemmaEJi and 

o 

t 

E( f \6„ - 6\ 2 ds) -> 0. The result follows. 

o 

Lemma 4. Let be progressively measurable such that St, 
t 

J" \9(s,w)\ 2 ds < oo a.e. 



Then Lt ^i{t,w) exists a.e. 

L— >oo 



Proof. Define 



t l (\y) = inf {s : f \6(o-,w)\ 2 dcr >1. 



clearly T£ is a stopping time. If L\ < r^iyv) < tl 2 {w) and by 
assumptions of the lemma 77, t 00 as L f °°. If 

U < L 2 , 9 Ll {s,w) = 9 Ll {s,w) for < s < r Ll (w). 

Therefore by Lemma|3 

fe(f,w) = &j(t,w) 

if < t < tl^w). Therefore as soon as L is large enough such that 
t < tl(w), £z,(f, w) remains constant (as a function of L). Therefore 
Lt £i(t, w) exists a.e. □ 

L— >oo 



191 



Definition. The stochastic integral of 9 is defined by 



f (9(s,w),dX(s,w)) = Lt fr(/,w). 



Exercise. Check that the definition of the stochastic integral given above 
coincides with the previous definition in case 



w)\ 2 ds 



< oo, Vt. 



Lemma . Let 9 be a progressively measurable function, such that 



j \0(s, 
o 



w)\ ds < oo, W. 



If g(t,w) denotes the stochastic integral of 9, then 

( T \ 

P | sup |f (r, -)| > ej < P \J \9\ 2 ds > L 



Proof Let r L = inf{? : j \9\ 2 ds > L). If T < t l (w), then 9 L (s,w) = 

o 

Also 

w) = f (t, w) for < t < T. 



Claim. 



w : sup |f (f, w)| > e 

()<?<r 



w : sup \^ L (t,w)\ > e\ U {w : t l (w) < T} 

0<t<T 
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For, if w is not contained in the right side, then 

sup |f £ (f, w)\ 2 < e and |t l (w)| > T. 

0<t<T 

If t l > T, g L (t, w) = %(t, w) W < T. Therefore 

SUp \t; L (t, W)\ = SUp |£(f, W)\ 

0<t<T 0<t<T 

Therefore w i left side. Since 



we get 



{w : t l (w) >T\ - 



w : J \9fds > L 
o 



PI sup m,-)\>e 

\0<t<T 



\9\ 2 ds > L 



+ P\ sup |&(r,.)| > 

\o<f<r 



<P|J |6fdj>L 

by Kolmogorov's inequality. This proves the result. 

Corollary . Let 9 n and 9 be progressively measurable functions such 
that 



(a) f \9 n (s, w)\ 2 ds < oo, f \9(s, w)\ 2 ds < oo, Vf; 



(b) Lt J \6 n (s, w) - 9(s, w)\ 2 ds - in probability. 



Ifg n (t,w) and £(t,w) denote, respectively the stochastic integrals of 
6„ and 9, then sup \g n (t, w) - g(t, w)\ converges to zero in probability. 
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Proof. Let T n ^{w) - inf{t : J\0 n \ 2 ds > L}; replacing 6 by 9 n - 9 and £ 



by % n - £ in the previous lemma, we get 



P\ sup \Ut,-)~tit,-)\>e 

\0<t<T 



[2 ' r 

— +P J \6 n (s,-)-6(s,-)\ 2 ds>L 



Letting n — > oo, we get 

limpfsup |^,.)-^,-)l>e)^. 

\0<f<T / € 

As L is arbitrary we get the desired result. 
Proposition . Let 9 be progressively measurable such that 



J \0(s, 



w)\ ds < oo, \ft and V w. 





Then 

(*) Z(t, •) = exp 



i r 

J (9(s,-),dX(s,-))-^J \9(s, 



fds 



is a super martingale satisfying 
(a) E(Z(t,-))< 1; 



(b) Lt £(Z(r, •)) = 1. 
f->0 



/Voo/ Let (#„) be a sequence of bounded progressively measurable 
functions such that 



fl| 2 </j -» Vf, Vw. 
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(For example we may take 8 n - 8 if \8\ < n, — otherwise). Then 
(*) is a martingale when 8 is replaced by 8 n . This martingale satisfies 
E(Z n (t,-)) - 1, and Z n (t,-) — > Z(t,-) pointwise (a) now follows from 
Fatou's lemma: 

\im E(Z(t, •)) > E\\imZ(t, •)) 
= £(1) = 1. 

Therefore Lt E(Z(t, •)) = !• This proves (b). □ 



24. Explosions 



Exercise. Let R > be given. Put b R - b<p R where <p R = 1 on \x\ > R, 
<f> R = if \x\ > R + 1; (p R is C°°. Show that b R = b on |x| < 6 R is 
bounded on R rf and is globally Lipschitz. 

Let Q T = {w e Q : B(w) > T). Let S 1 = Q T -> C[0, T] be the map 

l S ,r w = y(-) where = w(t) + Jb(y(s))ds on [0, T]. Unless otherwise 

o 

specifie b : R d — > is assumed to be locally Lipschitz. Define the 
measure <2^ on (O, T) by 

e^(A) = J P ;c {w:5 r weA,B(w)>r}, 

where P x is the probability measure corresponding to Brownian motion. 

Theorem . 

= J Z(T,-)dP x , VAe^ T , 



where 



Z(T, •) = exp 



A 
T 



J (b,dX)-^f \b(X(s,-))\ 2 ds 



-0 o 

Remark . If b is bounded or if b satisfies a global Lipschitz condition 
then B(w) = oo, so that Q.t = Q and Q T X are probability measures. 

Proof. Let < R < oo. For any w in Q., let y be given by 



w(t) + J b(y(o-))dcr. 

o 
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24. Explosions 



Define ctr{w) - mf{t : \y(t)\ > R and let b R be as in the Exercise. 
Then the equation 



y R {f) = w(t) + J b R (y R {o-))dcr 
o 

has a global solution. Denote by S r : Q. — > the map w — > jr. If Qr x 
is the measure induced by Sr, then 



R,x 



dP x 



ii i 
= Z r (t) = exp J dX> - l - J \b R \ 2 ds 



Let tr{w) = inf{? : |w(?)l > R}- tr is a stopping time satisfying 
trSr - (Tr. By the optional stopping theorem. 



(1) 



dQ R , x 



dP x 



&T R AT = Zr(Tr AT) = Z(t R A T). 



Claim. Qr, x ((tr >T)C\A) - Q l x ((r R > T) n A), VA in ^ r . 

Right side - P^w : > T, S r (w) e A n (t r > T)} 
= P x {w : B(w) >T,yeA, sup \y(t)\ < R} 

0<t<T 

= P x {w : y is defined at least upto time T, 
ye A, sup \y(t)\ > R} 

0<t<T 

= Pxiw :y R €A, sup \y R (t)\ < R} 

0<t<T 

= P x {w:S R (w)eA,TRS R (w)>T} 
= QrA{tr>T)^A\ 

(by definition). As Q is an increasing union of {tr > T] for R increasing, 



Q X (A) = It Qi((T R >T)n A), VA in & T , 

R^+oo 
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= It Q R A(TR>T)nA) (by claim) 



= a / exp \ j< b -<K>-yf\tfds 

(T R /\T)nA V o 
o o / 



dP x (by(l)) 



= J Z(T)dP,. 

A 



Theorem . Suppose b 



□ 



is locally Lipschitz; let L = — + b.V. 



(i) If there exists a smooth function u :R. d — > (0, oo) i«c/j m(x) — > 
oo |x| — > oo a«<i Lu < cufor some c > : B(w) < 
oo} - 0, i.e. for almost all w there is no explosion. 

(ii) If there exists a smooth bounded function u : M. d — > (0, oo) swc/i 
f/iaf Lu > cufor some c > 0, ^{w : B(w) < oo} > 0, i.e. 
there is explosion. 

Corollary . Suppose, in particular, b satisfies \{b{x),x)\ < A + B\x\ 2 for 
some constants A and B; then P x (w : B(w) < oo) = 0. 



Proof. Take u(x) = 1 + |x| 2 and use part (1) of the theorem. 



□ 



Proof of theorem. Let b% be as in the Exercise and let Lr = — + b^ ■ V; 
then Lru(x) < cu(x) if \x\ < R. 

Claim. u(X(t))e~ ct is a supermartingale upto time tr relative to Q R , 

/ t t > 

i(X(t))e~ ct exp J (b R , dX)-^J \b R \ 2 ds 
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24. Explosions 



~ctj(b R ,dXy^l\bR\ 2 ds 

e x 

\b R \ 



1. 



x{-cudt + (Vu,dX) + u(x)[(b R ,dX) — dt] + b R udt + -\b R fudt} 

t t 
= exp(-ct + J (b R ,dX) - X - J \b R \ 2 ds) 



■[L R - c)u + <Vw, dX) + u(b R , dX)]. 



Therefore 

f(b R ,dX)-^f\b R \ 2 ds 

u(X(t))e~ ct & 



IIS s 

- J exp\-cs + J(b R ,dX)- J \b R \ 2 ds 

V 

is a Brownian stochastic integral. Therefore 

T R M 



(L R - c)u{X{s))ds 



trM \ 



(X(t r A t)) exp -c{t r A t) + J (b R , dX)- 1 - J \b R \ 2 ds 

V 

TrM / S S \ 

- J exp \-cs + J(b R ,dX)-^J \b R \ 2 ds \{L R - c)u{X{s))ds 



is a martingale relative to P x , ^ TrM . But b R (x) - b(x) if \x\ < R. There- 
fore 



(X(r R A 0) exp -c(t r At)+ J (b, dX) - l - J \b\ 2 ds 

V 

TrM / S S \ 

-J exp -cs + J (b, dX) - J \b\ 2 ds (L R - c)u(X(s))ds 
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is a martingale relative to ,^ TrM - But (Lr - c)u < in [0, tr\. 
Therefore 



TrM TjtAt 



u(X(t r A 0) exp(-c(Tfl A + J (b, dX) - j J \b\ 2 ds) 

o o 

is a supermartingale relative to ^ TrM , P x - Therefore u(X(tr A f)e~ c(TRA?) 
is a supermartingale relative to (optional sampling theorem). There- 
fore 

E Q *(u(X(t R A t))e- c(TRM> < u(x); 



letting t — > oo, we get, using Fatou's lemma, 

£? (u(X( TR )e~ CTR ) < u(x). 



Therefore 



Thus 



E ^ (e -cr S) < u(x) 

mf |m(v)| 

\y\=R 

E P* (e -ccr R) < M « 



inf \u(y)\ 

\y\=R 



(by change of variable). Let R — > oo to get Lt f e c<TR dP x = 0, i.e. 
P x {w : B(w) < oo} = 0. 

Sketch of proof for Part (ii). 

By using the same technique as for Part (i), show that u{X{t))e~ ct is 
a submartingale upto time tr relative to Q R , so that 

P „_ u(x) u(x) 

E Px (e~ c<TR ) > -— ■ — > — — > 0; 

sup \u(y)\ ||m||oo 

\y\=R 

let R — > oo to get the result. 

Id 2 d 

Exercise. Show that if L 1- x 3 — , there is explosion. (Hint: take 

2 ox ox 

u = e tan ~' (x2) and show that Lu > u). 



25. Construction of a 
Diffusion Process 



Problem. Given a : [0, 00) x R d 



Sj, bounded measurable and b : 



[0, oo)xR d ^ R d bounded measurable, to find (Q, & u P, X) where Q. is 
a space, {^ t )t>o an increasing family of cr-algebras on Q., P a probability 
measure on the smallest cr-algebra containing all the J^'s. and X : 
[0, t) X Q — > R rf , a progressively measurable function such that w) e 



Let Q = C[0, 00); R"), /?(/,•) = ^-dimensional Brownian motion, 
^ = o"{jS(5) : < 5 < P the Brownian measure on Q. and a and & as 
given in the problem. We shall show that thee problem has a solution, 
under some special conditions on a and b. 

Theorem . Assume that there exists cr : [0, 00) xR d ^> M^ x „ (Md Xn = 
set of all dxn matrices over the reals) such that crcr* = a. Further let 



I[b(t,X t ),a(t,X t )]. 



J]\o-ij(t,x)\<C, 2j^(?,x)|<C, 
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Then the equation 

t t 
(1) f (r, •) = x + J (o-(s, f (j, •)), dfi(s, •)> + J Ks, f( s , -))^ 
o o 

196 /ias a solution. The solution g(t, w) : [0, oo) x Q — > R rf can £>e tafera 
to be such that g(t, •) is progressively measurable and such that g(t, •) is 
continuous for a, a.e. If^,rj are progressively measurable, continuous 
(for a.a.e) solutions of equation (I), then £ - nfor a.a.w. 

Proof. The proof proceeds in several steps. □ 

Lemma 1. Let Q. be any space with (J^ t )t>0 an increasing family of o~- 
algebras. If < T < oo then there exists a cr-algebra s/q c srf — 
£3\f), T) X such that a function f : [OJJxQ^R is progressively 
measurable if and only if f is measurable with respect to s/q. 

Proof. Let srf$ = {A e si : xa is progressively measurable}. Clearly 
[0, 1]xfie4 and if A e s/q, A c e gi c . Thus e/ Q is an algebra. As 
increasing limits (decreasing limits) of progressively measurable func- 
tions are progressively measurable, s/q is a monotone class and hence a 
cr-algebra. □ 

Let / : [0, T] x Q — > R be progressively measurable; in fact, / + = 
= ,/ =— ; — ■ Let g = f + . Then 



n2" 



(=1 



is progressively measurable. Hence nVg n is progressively measurable, 
197 i.e. nx g -i[ n ,oo) is progressively measurable. Similarly (f> g -i[t^. 4.) is pro- 
gressively measurable, etc. Therefore, by definition, g n is measurable 
with respect to s^q. As g - f + is the pointwise limit of g n , f + is mea- 
surable with respect to s/q. Similarly f~ is ^-measurable. Thus / is 
^-measurable. 
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Let / : [0, T] x Q, — > R be measurable with respect to £/q. Again, if 

g=r 



1=1 



') 



is ^-measurable. Since g l [n,oo),...g 1 [1—1,2-) e srf Q . So g n 
is progressively measurable. Therefore g is progressively measurable. 
Hence / is progressively measurable. This completes the proof of the 
Lemma. 

To solve (1) we use the standard iteration technique. 

Step 1. Let go(t, w) = x, 

t t 
g n (t,w) = x + J {o-{s,^ n -i(s,w)),dp(s,w)) + J b(s,^ n -i(s,w))ds. 
o o 

By induction, it follows that g n (t, w) is progressively measurable. 

Step 2. Let A n (t) = E(\g n+1 (t) - &(*)l 2 )- U0<t<T, A n (t) < C* J A„_j 

o 

(s)ds and Aq(0 < C*t, where C* is a constant depending only on T. 



Proof. 



A„(0 - E(m - x\ 2 ) 



I J ((s, x), dfi(s, x)) + J b(s, x)d 
o o 

<2e\\ f (o-{s,x),d/3{s,x))\ 2 ^ + 

t 

Jms, 



+ 2E 



, x)ds\ 



(use the fact that \x + y\ 



<2(\x\ 2 + \y\ 2 ) Vx,y€R a ) 



25. Construction of a Diffusion Process 





( ' ) 




( ' \ 


2E 


Tr cro-*ds 


= 2E 


| J b(s,x)ds\ 2 




,() 




, o / 



AoO) <2E\ J tr o-o- ds 



+ 2E\t 



J Ms, 





x)\ 2 ds 



(Cauchy-Schwarz inequality) 

< 2nd C 2 (l + T)t. 

K{t) = E{\U\{t)-Ut)\ 2 ) 

= E\ | f (o-{s,Us,w)) - ois,€n-l(s,w)W)+ 



+ 



< 2E 



+ 



J b{s,£n(s,w)) - b(s,Z„-i(s,w))ds\ 2 
t 

J (cr(s,% n (s,w)) - (s,£ n -i(s,w)),dfi(s,w))\ 2 

o 
t 

2E(\ J (b(s,Us,w))-b(s,^(s,w))ds\ 2 ) 



+ 



< 2E( J tr[(cr(s,Z n (s,w)) ~ ct<j,^_i(j,w))]x 
o 

X [<r*(s,t; n (s,w)) - <r*(s,t; n -i(s,w))]ds] + 

+ 2E^t J \b(s,t n (s,w))-b(s,tn-l(s,w))\ 2 ds 
t t 
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< 2dn A 2 (l + T) 



1 

J A n -i(s)ds. 



This proves the result. □ 

(C*t) n+1 

Step 3. A n (t) < —— Vn in < t < T, where 

(n + 1)! 

C* = max{2«J C 2 (l + T), and A 2 (l + T)}. 
Proof follows by induction on n. 

Step 4. £,|[o,r]xn is Cauchy in L 2 ([0, T] x Q, B([0, T] xQ,),fix P), where 
/I is the Lebesgue measure on [0, T]. 

(C*0' l+1 

Proof. A n (t) < implies that 

(n + 1)1 



II&+1 - fn\\l < 



(C* yy 1- *^ 



(n + 2)! 

Here || • || 2 is the norm in L 2 ([0, T] x Q). Thus 

CO 

^ II&+1 - €nh < °°, proving Step (4). 
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n=l 

□ 

Step 5. (4) implies that g„\[o,T]xa. is Cauchy in L 2 ([0, T] x Q,^,ju x 
P) where j^o is as in Lemma 1. Thus ^„|[o,r]xn converges to g T in 
L 2 ([0, T] x Q) where £ r is progressively measurable. 

Step 6. If f„|[ ,r 2 ]xo?r 2 in l2 ([°> r 2] x Q) and 200 

fnllftrjxnlr, «» £ 2 ([0, 7^] x Q), 

then ir 2 ||pj l]xQ = It, a - e - on [0, ri] x fl, Ti < T 2 . 

This follows from the fact that if % n — > £ in L 2 , a subsequence of 
(£„) converges pointwise a.e. to 
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25. Construction of a Diffusion Process 



Step 7. Let £ be defined on [0, oo) x Q, by £|[o,r]xn = We now show 
that 

r « 
w) = x + J (o-(s, f (s, •)), dp(s, •)> + J b(s, f (j, 
o o 
Proof. Let < t < T. By definition, 

f n (t, w) = x+ j \ois,f n -i(s, -)),dp(s,-)) + j b(s,ij„-i(s, -))ds. 



j {(o-(s, £,(*, 0) - <ris, f (j, w))), 48(j, 



tr[(cr(s, £„(s, w)) - ois, £(s, w)))(o-(s, £,(s, w)) - o-(*, £(s, 



< A J" J" |£,(s, w) - |0, w)| 2 ^ -> 



as n — > oo 



o n 



(by Lipschitz condition on <x). 
Therefore 



J" <<t(j,^„_i(j,w),4(8(j,w)> -> J (o-(s,€(s,w)),dJ3(s,w)) 
o 



in L 2 (Q, P). Similarly, 



r i 

J b(s,% n (s,w))ds -> J" b(s,^(s, 



w))ds, in L . 



Thus we get 



(*) 



f (f, w) = x + J~ (ois, %(s, w)), dJ3(s, w)> + 
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t 

+ J b(s,^(s,w))ds a.e. in t,w. 
o 

□ 

Step 8. Let g(t, w) = the right hand side of (*) above. Then £(f , w) is 
almost surely continuous because the stochastic integral of a bounded 
progressively measurable function is almost surely continuous. The re- 

oo 

suit follows by noting that [0, oo) = (J [0, n] and a function on [0, oo) is 
continuous iff it is continuous on [0, n], Vn. 

Step 9. Replacing | by £ in the right side of (*) we get a solution 

t t 
£(t,w) = x + J(o-(s,t),df3) + J b(s,Z(s,w))ds 
o o 

that is a.s. continuous Vf and a.e. 

Uniqueness. Let £ and 77 be two progressively measurable a.s. continu- 
ous functions satisfying (1). As in Step 3, 



r r 

E(\£(t,w) - x\ 2 ) < 2(E(J tr <r<r*ds) + 2E(t J b\ 2 ds) 


T T 

( J tr era-* ds + 2E(T J 



< 2E( I tr cro-*ds + 2E(T \ \b\ 2 ds), if < t < T 



< 00. 
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Thus E(\g(t, w)\ 2 ) is bounded in < t < T. Therefore 

cf>(t) = Em,w)-r 1 (t,w)\ 2 ) 

<2E(\at,w)\ 2 ) + 2E(\ J] (t,w)\ 2 ) 
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25. Construction of a Diffusion Process 



and so (f>(t) is bounded in < t < T. But 

t 

<f>{t) < 2dn A 2 (l + T) J 4>{s)ds 
o 

as in Step 2; using boundedness of <f>(t) in < t < T we can find a 
constant C such that 

t 

<p(t) < Ct and 0(0 < C J" 4>(s)ds, < t <T. 

o 

(CO" (CT)" 

By iteration (f>(t) < — — < ■ — . Therefore 

n\ n\ 

= on [0,T], 

i.e. £(?, w) - rj(t,w) a.e. in [0,T]. But rationals being dense in R we 
have 

£ = n a.e. and Vf. 
It is now clear that £ e I[b, a]. 

Remark. The above theorem is valid for the equation 

t t 
%(t,w)=x Q + J(cr(s,),dB) + J b(s,^)ds, Vt>t . 

to to 

This solution will be denoted by % to ,x - 

203 Proposition . Let (f> : C[(0, oo); R") -> C([t , oo); R d ) be the map send- 
ing w to g to ^ Xo ,P the Brownian measure on C([0, oo); R"). Let P to , XQ - 
P(f>~ 1 be the measure induced on C([to, oo); R d ). Define X : [to,°°) X 
C)[to,oo);M. d ) by X(t,w) = w(t). Then X is an ltd process relative to 
(C([tQ, oo); W 1 ), t0 ,P t0 ,x ) with parameters 

W,X t ),a(t,X t )]. 

The proof of the proposition follows from 
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Exercise. Let (Q, & t , P), (O, & u P) be any two measure spaces with X, 
Y progressively measurable on Q., Q. respectively. Suppose A : Q. —> Q. 
is such that A is (J^~ f , ^ f )-measurable for all t, and PA 1 - P. Let 
X(t,w) = Y(t, Aw), Vw e Q. Show that 

(a) If X is a martingale, so is Y. 

(b) If X e I[b(t, X t ), a(t, X,)] then 
Ye I[b(t, Y t ),a(t,Y t )l 

Lemma . Let f : R 2 — > R be (Q, P)-measurable, 2 a swft - cr - algebra 
of Let X : Q — > R and F : Q — > R &e smc/i ?/ia? X is J^-measurable 
and Y is Yj-independent. If g(w) = f(X(w), Y(w)) with E(g(w)) < oo, 

£fel£)(*»0 = £</(*, 1%^< W ), 
£(/(x,y)| z )(w) = J /(X(w),y(w'))W). 

n 

Proof. Let A and B be measurable subsets in R. The result is trivially 204 
verified if / = Xa.-x.b- The set 

srf = {Fel : the result is true for X F \ 



is a monotone class containing all measurable rectangles. Thus the 
Lemma is true for all characteristic functions. The general result fol- 
lows by limiting procedures. □ 



26. Uniqueness of Diffusion 
Process 



IN THE LAST section we proved that 
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€(t, w) -x + J (cr(s, f (j, w)), dfi(s, w) + J b(s, (s, w)ds 



has a solution under certain conditions on b and cr where crcr* = a. The 
measure r to ,x = Pt~] X0 was constructed on (C(fo>, oo); R d ), & to ) so that 
the map X(t, w) = w(t) is an Ito process with parameters b and a. We 
now settle the uniqueness question, about the diffusion process. 



Theorem . Let 

(i) a : [0,oo) xl^^ and b : [0,oo) x 
measurable functions; 



M. d be bounded 



(h) a = c([0,y,R d ); 

(iii) X : [0, oo) x Q, R d be defined by X(t, w) = w(t); 

(iv) X t = cr{X(s) :0<s<t\; 

(v) P be any probability measure on 



- cr 



Vf>0 
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26. Uniqueness of Diffusion Process 



such that P{X(0) = xq] = 1 and X is an ltd process relative to 
(O, X t , P) with parameters b(t, X t ) and a(t, X t ); 

(vi) cr : [0, oo) x M. d — > M c j Xn be a bounded measurable map into the 
set of all real dxn matrices such that o~o~* = a on [0, oo) x R. rf . 

Then there exists a generalised n-dimensional Brownian motion B 
on (O, J^ t , Q) and a progressively measurable a.s. continuous map £ : 
[0, oo) x Q — > W 1 satisfying the equation 

t t 
(1) f(t,w)=xo + J(o-(s,J(s,w)),dB(s,w)) + J b(s,t(s,w))ds 



with Q^ 1 = P, where £:Q.^Q,is given by = g(t, w). 

Roughly speaking, any Ito process can be realised by means of a 
diffusion process governed by equation Q with crcr* = a. 

Proof. Case (i). Assume that there exist constants m, M > such that 
ml < a(t, x) < MI and cr is a d x d matrix satisfying crcr* - a. In this 
case we can identify (O, £ f , Q) with (Q, & u P). Since D(t, •) is an Ito 
process, 

..„„„./»,.„,„./„,,,„, 



is a (Q, P)-martingale. Put 

t 

Y(t, w) = w) - f - jc . 

o 

Clearly F(f, w) is an Ito process corresponding to the parameters 



[0,flCr,X,)] t 
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so that 

t 

exp<0, Y(t, w)> - i J~ (6», -))6>>^ 
o 

is a (O, P)-martingale. The conditions m < a < M imply that cr _1 
exists and is bounded. Let 

t t 

i 1 (t) = J cr~ l dY = J o--\s,X(s,-))dY(s,-), 



so that (by definition of a stochastic integral) rj is a (Q., J^ t , P )-It6 pro- 207 
cess with parameters zero and cr~ l a(cr~ 1 )* - 1. Thus rj is a Brownian 
motion relative to (Q, P). Now by change of variable formula for 
stochastic integrals, 

t t 
J"crdT] = J crcr' l dY 



= Y(t) - Y(0) = Y((t), 

since Y(0) = 0. Thus 

t t 
X(t) = x + J cr(s,X(s,-))d + J b(s,X(s,-))ds. 



Taking Q = P we get the result. 

Case (ii). a = 0, b = 0, x = 0, <x = where a e M dXn . Let (Q*,^*,P*) 
be an ra-dimensional Brownian motion. Define 

(n, J], = (fixn*,# ( x#;,px />*)• 

If /3 is the ra-dimensional Brownian motion on (Q.*, ^* ,P*), we de- 
fine /3 on Q. by w, w*) - fi(t,w*). It is easy to verify that /3 is an 
^-dimensional Brownian motion on (Q, Q). Taking f (f, w, w*) - xo 
we get the result. □ 
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26. Uniqueness of Diffusion Process 



Before we take up the general case we prove a few Lemmas. 

Lemma 1. Let a : R" -> R d be linear crcr* - a : R d -> R d ; then 208 
there exists a linear map which we denote by o~~ l : R. d — > W such that 
cr^acr^ 1 * = n N ±, where n denotes the projection and No- null space of 
cr. 

Proof. Let P (T = range of cr. Clearly cr : — » R is an isomorphism. 
Let t : Rg- — » TV^: be the inverse. We put 

cr" 1 = t © : P^ © P^: -> A£ © No-. 

□ 

Lemma 2. Le? X, Y be martingales relative to (£1, J^ f , P) awcf (O, J^" f , P) 
respectively. Then Z given by 

Z(t,w,w) = X(t,w)Y{t,w) 
is a martingale relative to 

(HxQ, J^XJ^,PXP). 
Proof. From the definition it is clear that for every t > s 

J Z(t,w,w)d(P X?)|^ = J Z(s,vv,w>/(PxP) 

AxA AxA 

if A € ^ and A € JF S . The general case follows easily. □ 

As a corrollary to LemmaEJ we have 

Lemma 3. Let X be a d-dimensional ltd process with parameters b and 
a relative to (Q, & t , P) and let Y be a d-dimensional ltd process relative 
to (O, J^ t , P) relative to b and a. Then Z(t, w, w) - (X(t, w), Y(t, w)) is a 
(d + d)-dimensional ltd process with parameters B — (b, b), A - \ q ~ ] 

relative to (O xfl,J,x ~W U P x P). 



215 



209 Lemma 4. Let X be an ltd process relative to (Q, P) with parame- 

t 

ters and a. If 8 is progressively measurable such that E{ J \9\ 2 , ds) < 

o 

t 

oo, \/t and 9a9* is bounded, then J (9, dX) e I[0, 6a6*]. 

o 



Proof. Let n be defined by 



0'n = 



\8\ \£\0\<n, 
1 0, otherwise; 



Then j(9 n ,dX) e I[0,9 n a9* n ]. Therefore 



2 

X n (t) = exp(i j (9 n ,dX) - y J (9 n ,a9 n )ds 



o o 
is a martingale converging pointwise to 



X(t) = exp L J~ <0, JX> - y J~ <0, a(9>d.s 



To prove that J (0, dX) is an Ito process we have only to show that 


X n (t) is uniformly integrable. Without loss of generality we may assume 
that A = 1. Let [0, T] be given 



E(X 2 n (t,w)) = E 



= E exp 



2 J <0 B ,dar>- J (9 n , a9 n )d 

o o 

r t 

2 J (9 n ,dX)-2 J (9 n ,a9 n )ds 
o 

J(9 n ,a9 n )ds 
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< e T sup (9 n ,a8 n ). 

0<t<T 

But (9, a9*) is bounded and therefore (9 n , a9 n ) is uniformly bounded 
in n. Therefore (X n ) are uniformly integrable. Thus X(t, •) is a martin- 
gale. 

Case (iii). Take d - 1 , and assume that 

t 

J a~ 1 X(.a>Q)ds <oo,Vt 


with a > 0; let cr = +ve squareroot of a. Define 1/cr = 1/cr if cr > 0, 
and 1/cr = Oif cr = 0. Let 

r 

7(0 = X(t) -xo - f b(s,X(s))ds. 
o 

Denote by Z the one-dimensional Brownian motion on (Q.*, J^"* , P*) 
where O* = C([0, «>),/?). Now 

Fe/[0,a(j,X(j,-))], Z € 7[0, 1]. 

By Lemma 13 

(F,Z) 6 /I (0,0): | 

If 

t 

T](t,W,W*)= I ( — — — — -X(o->0),Xo-=o,d(Y,Z)) 
J \o-(s,X(s,-J) 



then Lemma|3] shows that 

nel[0, 1]. 

Therefore ?y is a one-dimensional Brownian motion on Q = (Q x 
Q'.^x^'.PxP*). Put 

F(f, w, w*) = F(f, w) and X(f, w, w*) - X(f, w); 



a 
1 
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211 then 



J o-d?] = J o-^X(cr>Q)dY + J o-X(<r=Q)dZ 



t 

= J X(o->0)dY. 







Since 



(< t 



it follows that 



J X(a-=0)dY 



t t 



= E 



J cr 2 X(cr=0)ds 



\0 



= 0, 



j"o-dj] = J"dY = Y(t) = Y(t,w,w*). 



o o 



Thus, 



X(t, w, w*) = Xq + 



+ 



^ cr(s, X(s, w, w*)dr]+ 
o 

t 

J b(s, X(s,w,] 



,w )ds 



with X(t, w, w*) - X(t, w). Now 



(P x P*)X (A) = (P x P*)(A x Q*) - 



Therefore 



{P x 1 = P or <2X 1 = P. 
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Case (iv). (General Case). Define 



Y(t, •) = X(t, •) - x Q 



f b(s,X(s, 



))ds. 



Therefore Y e I[0, a(s, X(s, •))] relative to (O, & t , P). Let Z be the 212 
ra-dimensional Brownian motion on (Q*, <^*,P*) where 

Q* =C([0,oo);R„). 



(Y,Z) I 



(0,0); 



a(s, X s ), 
/ 



Let cr be a d x « matrix such that crcr* = a on [0, oo) x R . Let 



,w,w*) = J 



cr l (s,X(s,w))dY(s,w) + J ' r^ ir {s,Z{s,w*))dZ{s,w*) 



= J {{o--\s,X(s,w)),n Na {s,Z{s,w*))),d{Y,Z)). 



Therefore rj is an Ito process with parameters zero and 



a 0\ /a-" 1 * 
= ^^(cr" 1 )* +n Ncr n N * a . 



= jt^ + tta^ (for any projection PP* - PP - P) 

= Ir"- 

Therefore rj is ^-dimensional Brownian motion on 

(H,W t ,p) = (o x n*,3? t x ^;,px p*). 

t 

^ cr(s, X(s, w))di](s, w, w*) 
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= J~ cr(s, X(s, w, w*))dj](s, w, w*), where X(s, w, w*) = X(s, w), 
o 

t t 

- J~ crcr~ 1 <f 7 + J~ (TJTfj^dZ. 


t 

- J n Rcr dY, since <x<x _1 = n Ra and crn^ = 0, 
o 

t 

-/< 



(1 - nnJdY. 



Claim. / n R JY = 0. 
o 

For 



J n Rcr dY - J an Rcr ds = J crcr*n RiT ds 
) J o o 



o-(0)ds = 0. 



Therefore we obtain 



□ 213 



J o-(s,X(s,w))dj](s,w,w*) = J dY = Y(t) - 7(0) = Y(t) 





putting Y(t, w, w*) - Y(t, w), one gets 



T 

X(t, w, w*) - xq + ^ cr(s, X(s, w, w*))drj(s, w, w*) 
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26. Uniqueness of Diffusion Process 



t 

+ 

o 

As in Case (iii) one shows easily that 



^ b(s, X(s, w, w*))ds. 



(P x P*)X 1 = P. 
This completes the proof of the theorem. 

Corollary .Let a : [0,oo) xW 1 S + and b : [0,oo) xR d ^ R d 
be bounded, progressively measurable functions. If for some choice of 
a Lipschitz function cr : [0, oo) xR d — > M^ n , era* = a then the ltd 
process corresponding to [b, a) is unique. 

To state the result precisely, let Pi and P2 be two probability mea- 
sures on C([0, oo);R rf ) such that X(t, w) = w(t) is an Ito process with 
parameters b and a. Then Pi = P2. 

Proof. By the theorem, there exists a generalised ra-dimensional Brow- 
nian motion on (O,-, Ytf Qi) an d a map £ : Q ; — > Q satisfying (for 
i = 1,2) 



t 



i M = XQ + 



J o-{s, &{s, w))d/3i{s, w) + J b{s, w))ds. 



rndP^Q^ 1 . 

Now cr is Lipschitz so that is unique but we know that the iter- 
ations converge to a solution. As the solution is unique the iterations 
converge to Each iteration is progressively measurable with respect 
to 

\ = o-{/3i(s); < s < t] so that is also progressively 

measurable with respect to &\. Thus we can restate the result as follows: 
There exists (Q,-, Qi) and a map : Q; — > Q satisfying 

t 

&(t, w) = x Q + J o-(s, £0, w))d/3i(s, w) 
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+ J' M.N. £',(. S.U-: 







(Cli, &\, Qi,Pd can be identified with the standard Brownian motion 
(Q\ (2,j8). Thus Pi = - P 2 , completing the proof. □ 



27. On Lipschitz Square 
Roots 



Lemma . Let f : R -> Rbe such that f(x) > 0, f(x) e C 2 and \f"(x)\ < 215 
A on (—oo, oo); 

|/'(x)|< V7WV2A. 

< /(y) = /(x) + (y - *)/(*) + Q^ff'tf) 
</(l)tZ/'(l)+y/"© 

AZ 2 

where Z = y - x, or f(y) < f(x) + Zf'(x) + — — ■ Therefore 
AZ 2 

— +Zf(x) + f(x)>0, VZeR 
\f'(x)\ 2 < 2A f{x). 

So 

l/'WI < V2A/(x). 

□ 

Note. If we take f(x) = x 2 , we note that the constant is the best possible. 
Corollary . Iff > 0, \f"\ < A, then 

lV(/(*i)) - V(/fe)) < y/(A/2)\xi - x 2 \. 
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Proof. Let e > 0, then V(/W + e) is a smooth function. 

/'(x) (/(x) + eY 



(V(/(X) + 6))' - 



2V(/(x) + 6) 2V(/(x) + 6)- 
Therefore 

|(V(/W + e))'\ < V(2A/2) < V(A/2), 

or 

lV(/(*i) + 6) - V(/fe) + 6)1 < V(A/2)|X! - x 2 |. 
Let e — > to get the result. 

We now consider the general case and give conditions on the matrix 
a so that cr defined by crcr* = a is Lipschitz. □ 

Theorem . Let a : W — > 5^ be continuous and bounded C 2 -function 
such that the second derivative is uniformly bounded, i.e. \\D s D r aij\\ < 

M, where M is independent of i, j, r, s; (D r = — — ). If cr : W — > St is 

dx r a 

the unique positive square root of a, then 

||cr(xi) - cr(x 2 )|| < A|xi - x 2 |, Vxi,x 2 ,A = A(M,d). 

Proof. 

Step 1. Let A € S + d be strictly positive such that ||7 - A|| < 1. Then 

VA = V('-('-A)) 



r 

r=Q 



so that on the set {A : ||7 - A|| < 1} the map A — > is C°° (in fact 
analytic). 

Now assume that A is any positive definite matrix. Let A\,...,A n 
be the eigen values so that Aj > 0, j - 1, 2 . . . n. Therefore / - eA is 
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aymmetric with eigen values 1 - eAj. By choosing e sufficiently small 
we can make 

||7 - eA\\ - max{l - eX\, . . . , 1 - eA n } < 1. 
Fixing such an e we observe that 

VA - ^(eA) = i-V(/ - (/ - eA)). 

217 

So the map A — > VA is smooth on the set of symmetric positive 
definite matrices. 

Step 2. Let n - 1 , o~(?o) = V( a (^o) where a(?o) is positive definite. As- 
sume a(to) to be diagonal so that <x(to) is also diagonal. 

^ o-ij(t)o-j k (t) = a ik (t). 

j 

Differentiating with respect to t at t = to we get 

^ 0-ij{to)o-' jk {to) + ^ O"-y(?0)o"yyt(^0) = %(?o) 

j j 

or 

^au(to)o-' ik (t ) + ^a kk (t )o-' ik (to) = a' ik (t ) 

or 

, ({) = 

ik V(«i.<A>)) + V(«ttfo))" 

Since the second derivatives are bounded by 4M and au-laij+ajj > 
0, we get 

14(0 + + a' n (t)\ < V(8M)V(flff(0 + 2a ;7 (0 + a i7 (0) 

< V(8M)V2V(a,7 + a#)(f) 

or 

(1) 14(0 + 2a; .(0 + a' n (t)\ < 4VM(Va«7 + V«#)- 
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27. On Lipschitz Square Roots 



Since a is non-negative definite, 

\a' n (t)\ < V(2M)V(a,(0), Vi. 
substituting this in Q, we get 

K/OI < 4VM(Va,v + V";;), 

and hence 

\o-' u {t )\ < 4VM. 

Step 3. Let a(to) be positive definite and cr its positive definite square 
root. There exists a constant unitary matrix a such that aa(to)a~ l = b(to) 
is a diagonal positive definite matrix. Let A(to) be the positive square 
root of b(to) so that 

A(t ) - acr(t )a~ l . 
Therefore a* (to) = (a~ l A'a)(to) where (cr'(f )),-; = crj .(fo) and 

a"(t ) - (a~ l b"a)(t ). 

Since a is unitary. 

\\M = \\crUa''\\ = \\b'%U'\\ = \\cr'\\. 
By hypothesis, \\b"\\ = \\a"\\ < C(d) ■ M. Therefore 
IU'11 < 4V(MC(c/)), 

i.e. 

llcr'H < 4V(MC(d)). 
Thus ||(T(/i) - crfe)|| < \t { - t 2 \C(M,d). 

Step 4. Let a : R — > 5t and cr be the unique non-negative definite 
square root of a. For each e > let a e = a + el, o~ e = unique positive 
square root of a £ . Then by step 3, 

\\o- e (h)~o- e (h)\\<C(M,d)\h-h\. 
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If a is diagonal then it is obvious that cr e — > cr as £ — > 0. In the 
general case reduce a to the diagonal form and conclude that cr e — > cr. 
219 Thus 

l|o-(fi) - cr(/ 2 )|| < C(Af,d)|/! - f 2 |. 

Step 5. Let a : W -> 5+ and cr 2 = a, with \\D r D s aij\\ < M, Vx, /, j; r, 
s x eR". Choose x\, X2 e R". Let x\ - y\, yi, . . .,y n +\ - *i be (n + 1) 
points such that yi and differ almost in one coordinate. By Step 4, 
we have 

(*) Hero,) - frOi +1 )|| < 

The result follows easily from the fact that 

n 

Nil = J] \xA and |M| 2 = (*! + ••• + x„) 1/2 
i=i 

are equivalent norms. 

This completes the proof of the theorem. 



□ 



28. Random Time Changes 



LET 
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d 2 | y b d 



with a : M. h — > S J and b : R rf — > R d bounded measurable funcitons. Let 
X(t, •), given by X(t, w) = w(t) for (t, w) in [0, 00) x C([0, 00) : R d ) be an 
Ito process corresponding to (Q., ^ u Q) with parameters b and a where 
O = C([0, 00); R rf ). For every constant c > define 



L c = c 



d 2 



dx;dx 1 



Define Q c by Q c - PT~ l where (T c w)(t) = w(ct). Then one can 
show that X is an Ito process corresponding to (Q., J^ t , Q c ) with param- 
eters cb and ca [Note: We have done this in the case where a,y = <5^]. 

Consider the equation 

— = L c u with m(0, x) - f(x). 
ot 



du 

This can be written as — = Lu with u(0, x) = f(x) when t - ct. 

OT 

Thus changing time in the differential equation is equivalent to stretch- 
ing time in probablistic language. 

So far we have assumed that c is a constant. Now we shall allow c 
to be a function of x. 
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28. Random Time Changes 



Let <p : R d — » R be any bounded measurable function such that 
< Ci < 0(x) < C 2 < oo, Vx e R J 
and suitable constants C\ and C 2 . If 



L = 



d 2 



lJ dxjdxj 



we define 



(f>L = (f> 



d 2 

2 " l] dxidxj ' dxj 



+ 



In this case we can say that the manner which time changes depends 
on the position of the particle. 
Define 7^ : Q. — > Q by 

(r^w)(0 - w(T t (w)) 

where T f (w) is the solution of the equation 

ds 



! 



<P(w(s)) 



As C\ < (p < C 2 it is clear that r t — < t < r t — . When (p = c a 

C\ C 2 
constant, then t, = ct and T* coincides with T c . 



As 



0<Ci<(p<C 2 <°° 



, f-^—ds 



is continuous and increases strictly from to 00 as A increases, so that 
T t exists, is unique, and is a continuous function of t for each fixed w. 

Some properties of T<p. 

(i) If / is the constant function taking the value 1 then it is clear that 
Ti - identity. 
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222 (ii) Let cf> and ifj be two measurable funcitons such that < a < (p{x), 
ip{x) <b<oo,\/xe R d . Then 7> o T = T n = 7> o T^. 

Proof. Fix w. Let r t be given by 

r, 

ds = t. 

0(w(,s)) 



Let w*(t) = w{r t ) and let cr t be given by 



—ds = t. 

0)) 
o 

Let w**(t) - w*(cr t ) - w(t<t ( ). Therefore 



«7> o r^)w)(o - (7>*xo - w '(<r f ) 

= = w(To- ( ). 

Hence to prove the property (ii) we need only show that 

To; 

f_! L 

J <f>(w(s)) if/(w(s 



-ds = t. 

0)) 



Since 



dt 1 

-ds = t. 



I <t>(w( 



and 



v(s)) dr, <f>(w(T t )) 

o 



1 1 



Therefore 



do- t ip{w*{o- t )) i/f(w(To- t )) 
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= (WXrtjo.,)). 

Thus 

TVr, 

r ! 

-ds = t. 



223 



/ woo 



This completes the proof. 



w(s)) 





(iii) From (i) and (ii) it is clear that 7^ 1 = T^-i where (p 1 = 

(iv) (r f ) is a stopping time relative to r f . i.e. 

= f— 



1 

■ e A for each i > 0. 



w : I (i^ > r 

')) 

o 



(v) 7>(w)0) - w(t,w) - X T( (w). 

Thus T is (J^ - J^-measurable, i.e. T^(^ t ) c J*" Tf . 

Since X(t) is an Ito process, with parameters b, a, V/ € 

/(X(0) - / (Lf)(X(s))ds is a martingale relative to (Q, & t , P). By the 

o 

optional sampling theorem 

f(X Tt ) - J (Lf)(X(s))ds 
o 

is a martingale relative to (O, ^ T) ,P), i.e. 

/« - J (Lf)(X(T s ))dT s 
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dr 

is a martingale relative to (f2, & Tt , P). But — = 0. Therefore 

dt 



f(X(r t )) - J (Lf)(X Ts )<f>(X Ts )ds 



o 

is a martingale. 224 
Put Y(f) - X Tt and appeal to the definition of L^ to conclude that 



f(Y(t)) - J {L^f){Y{s))ds 



is a martingale. Y(t, w) = X Tt (w) = (T^wXt). Let & t = cr{Y(s) : < s < 
t). Then ~W t = T~ l {& t ) c & Tt . Thus 

t 

f(Y(t)) - J {L^f){Y{s))ds 
o 

is a martingale relative to (£2, & ',, P). Define Q = PT~ l so that 

t 

f(X(t)) - J {L^f){X{s))ds 
o 

is an (Q, ©-martingale, i.e. Q is an Ito process that corresponds 
to the operator <j>L. Or, PT^ 1 is an Ito process that corresponds to the 
operator <pL. 

We have now proved the following theorem. 

Theorem . Let Q. - C([0, oo); R d ); X(t, w) = w(t); 

i,j 1 j j 

Suppose that X(t) is an ltd process relative to (O, & t , P) that corre- 
sponds to the operator L. Let < C\ < <p < C2 where (p : R. d — > R 225 
is measurable. If Q - PT^ 1 , then X(t) is an Ito process relative to 
(Q,, JP t , Q) that corresponds to the operator (/>L. 
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As < Ci < (f> < C 2 , we get < 1/C 2 < 1/0 < 1/Ci with 
T^-i oT^ = I. We have thus an obvious corollary. 

Corollary . There exists a probability measure P onQ. such that X is an 
ltd process relative to (Q,, & u P) that corresponds to the operator L if 
and only if there exists a probability measure Q on Q. such that X is an 
Ito process relative to (Q,, Q) that corresponds to the operator <f>L. 

Remark. If C2 > (f> > C\ > then we have shown that existence and 
uniqueness of an Ito process for the operator L guarantees existence and 
uniqueness of the Ito process for the operator <ph. The solution is no 
longer unique if we relax the strict positivity on C\ as is illustrated by 
the following example. 

1 d 2 

Let (f> - a(x) - \x\ A 1 where < a < 1 and let L = -a — . Define 

2 ox 

<5 on{C([0,cx 3 );]R)}by 



60(A) - 



(1, if 6eA, VAe, 
0, if 9<tA, 



where 9 is the zero function on [0, 00). 

Claim. So is an Ito process with parameters and a. For this it is enough 
to show that, V/ e C~(R) 

t 

f(X(t)) - J (Lf)(X(s))ds 


226 is a martingale, using a(0) - 0, it follows easily that 

t 

{Lf)(X«r))diTd6o = 

A 

V Borel set A of C([0, 00); R) and f f(X(t))d6 Q - if 9 $ A and 

A 

J f(X(t))d6 = /(0) 

A 



1 
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if 6 € A, and this is true W, showing that X(t, w) = w(t) is an Ito process 
relative to 8q corresponding to the operator L. 

Next we shall define T a (as in the theorem); we note that T a cannot 
be defined everywhere (for example T a {9) is not defined). However T a 
is defined a.e. P where P = Pq is the Brownian motion. 



Taking t - 1, 2, 3 . . ., there exists a set Q.* such that P(Q*) = 1 and 




since < a < 1. Thus by Fubini's theorem, 




a.e. 



o 








Observe that 








implies that 




o 



for 
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[QM\Ms)\ a >\} 



{|w(.vr<l)[(),r] 
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t 



< m 




I Of 



ds < oo 





(m = Lebesgue measure) 



Thus T a is defined on the whole of O*. Using the same argument 
as in the theorem, it can now be proved that X is an Ito process relative 
to Q corresponding to the operator L. Finally, we show that Q{9} - 0. 
Q{6} = PT a l {6). Now: T a l {6} = empty. For, let w e T~ l {0}. Then 
w(r ( ) = 0, Vf, w e Q.*. Since \r t - t s \ < \t - s\, one finds that r t is a 
continuous function of t. Further ti > 0, and w = on [0, ti ] gives 



This is false unless T a l {9) = empty. Thus Q{6} = and Q is differ- 
ent from So. 




o 



29. Cameron - Martin 
Girsanov Formula 



LET US REVIEW what we did in Brownian motion with drift. 
Let (O, & u P) be a J-dimensional Brownian motion with 



Let b : R d — > R d be a bounded measurable function and define 



Then we see that Z(t, •) is an (O, & t , /^-martingale. We then had a 
probability measure Q given by the formula 



We leave it as an exercise to check that in effect X is an Ito process 
relative to Q with parameters b and /. In other words we had made a 
transition from the operator A/2toA/2 + &- V. We now see whether 
such a relation also exists for the more general operator L. 

Theorem . Let a : JH d — > be bounded and measurable such that 
a > CI for some C > 0. Let b : W 1 -» R d be bounded, ^ - ([0, oo); M. d ), 
X(t, w) = w(t), P any probability measure on Q. such that X is an ltd 



P{w : w(0) = x] = 1. 
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process relative to (Q, & t , P) with parameters [0, a]. Define Q' on & t 
by the rule 



dP 



= Z(t, •) - exp 



r r 

j (a~ l b,dX)-j J (b,a- l b)ds 



Then 

(i) {0'}t > is a consistent family. 

(ii) there exists a measure Q on o~(\\^ t ): 



Q 



(iii) X(t) is an ltd process relative to (Q,, & u Q) with parameters [b, a], 
i.e. it corresponds to the operator 

I v 32 v* A 



I— J j —J 



Proof. (i) Let A(t) = J(a~ l b,dX). Then A e 7[0,<M -1 &>]. 
o 

Therefore Z(t) is a martingale relative to (Q, ^ t ,P) hence |<2'} f >o 
is a consistent family. 

(ii) Proof as in the case of Brownian motion. 

(iii) We have to show that 

t t 
exp[(6, X(t, •)> - (9, J bds) ~jf(0, a8)ds] 


is a martingale relative to (Q, JP t , Q). 
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Now for any function 9 which is progressively measurable and boun- 
ded 



exp[ J (9,dX) -j J (9,a9)ds_ 



230 is an (Q, & u /^-martingale. Replace 9 by 9{w) - 9 + {a l b)(x(s,w)), 
where 9 now is a constant vector. Then 

t t 
exp[ J (9 + a~ l b,dX)-^ J {9 + cT l b,a9)ds 
o o 

is an (Q, & u /^-martingale, i.e. 



t 

./>>] 





exp[<0,X(r)> - i J <0,a0>ds - X - J (a l b,a9) ~\J<0,i 



is an (Q, & t , ©-martingale, and 



(a~ l b,a9) = {a*cf l b,9) 

= (aa~ 1 b, 9) (since a - a) 
= (b,G). 



Thus 



exp[(0,X(t)) -^J (9,a9)ds - J (9,b)ds] 
o o 

is an (O, & t , ©-martingale, i.e. X is an Ito process relative to & t , Q) 
with parameters [b, a]. This proves the theorem. □ 

We now prove the converse part. 
Theorem . Let 

Ll = 2 2j l ' jai i' 



2 ±— ' dxjdxj 
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29. Cameron - Martin - Girsanov Formula 



and 

2 ^ "''Ik'UTi + '1)7;' 

i i 'J i J 



where a : M. d — > is bounded measurable such that a > CI for some 
C > 0; b : R d -> R d is bounded and measurable. Let Q. - C([0, oo); R d ) 
with as usual. Let 6 be a probability measure on cr(U^i) and X a 
progressively measurable function such that X is an ltd process relative 
to (Q, J^, Q) with parameters [b,a] i.e. X corresponds to the operator 
L2. Let 

t t 
Z(t) = exp[- j ( a - l b,dX) + jj (b, a - l b)ds}. 


Then 

(i) Z(f) is an (O, & t , Q)-martingale. 

(ii) If P' is defined on ^ t by 



dP' 
dQ 



Then there exists a probability measure P on cr(UJ^) such that 

P =P' 

(iii) X is an ltd process relative to (Q, jF f , P) corresponding to param- 
eters [0, a], i.e. X corresponds to the operator L\. 

Proof. (i) Let 

t 

A(t) = J (- a - l b,dX). 


Then A(t) is an Ito process with parameters [(-a~ l b,b),(a~ l b,b)]. 
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Thus 



exp[A(r) - J (-a { b,b)ds - ^ J" (a l b,b)ds} 


is an (O, & u 0-martingale, i.e. Z(t) is an (O, © martingale. 

(ii) By (i), P' is a consistent family. The proof that there exists a 232 
probability measure P is same as before. 
Since X is an Ito process relative to Q with parameters b and a, 

t t t 

exp[ J (G,dX) - J (6,b)ds -jj {6,a6)ds] 
o o o 

is a martingale relative to Q for every bounded measurable 9. Replace 6 
by 9(w) = 9- (a~ l b)(X(s, w)) where 9 now is a constant vector to get 

t ? f 

exp[(0,X(t)) - J (aT l b,dX) - J(9,b) + J (aT l b,b)ds- 



t 

~\\ ( d - a ~ lb > a6 - b ) ds ] 





is an (Q, J£" t , martingale, i.e. 

t 



exp[<0,X> - J (<T l b,dX) - J (9,b)ds + J (cT l b,b)ds- 

o o o 

t t t 

-\§(0, aG)ds - I JV^, b)ds + X - J (9, b)ds 



t 

■ J~(a~ l b, a6 



+ J {cT l b,a6)ds\ 
o 
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is an (Q, & t , Q) martingale. Let 6 e R d , so that 

t t t 

exp[<0,X> -^J (6,b)ds -^J (6,a6)ds + jj {a x b,aQ)ds\Z{t) 
o o o 

is an (H, J£" t , 0-matringale and 

(cf x b, a) - (b, G) (since a - a). 

Therefore 

t 





jO)ds]Z(t) 



is an (Q, J£" t , 2) martingale. 

Using the fact that — 
"2 



= Z(0, we conclude that 



exp[<0,X>-i J <0,a0>dj] 



is a martingale relative to (O, P), i.e. X e 7[0, a] relative to 

(Q,^,p). 

This proves the theorem. [ 
Summary. We have the following situation 

LuQ^t, H = C([0,oo);R d ), L 2 , o, & t . 

' X is an Ito process relative 
to a probability measure Q 



P a probability measure 
such that X is an Ito Pro- 
cess relative to P corre- 
sponding to the operator 
U. 



corresponding to L 2 . Q is 
dQ 



given by - 



= z(/,o 



X is an Ito process relative 
to P corresponding to L\ 



dP 
where —— 
dQ 



1 



^ Z(f, •) 



' X is an Ito process relative 
to Q corresponding to L 2 . 
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Thus existence and uniqueness for any system guarantees the exis- 
tence and uniqueness for the other system. 

Application. (Exercise). 

Take d - 1, a : R — > R bounded and measurable with < C\ < 

ad 2 d 

a < C2 < °°- Let L + b — . Show that there exists a unique 

2 dx 1 ox 

probability masure P on Q. - C([0, 00); R) such that X(t) is Ito relative 
to P corresponding to L. (X(t, w) = w{t)) for any given starting point. 



30. Behaviour of Diffusions 
for Large Times 



LET L 2 = A/2 + b ■ V WITH b : R d -> R d measurable and bounded 235 
on each compact set. We assume that there is no explosion. If P x is the 
ci-dimensional Brownian measure on Q, = C([0,oo);R rf ) we know that 
there exists a probability measure Q x on Q. such that 



Let K be any compact set in M. d with non-empty interior. We are 
interested in finding out how often the trajectories visit K and whether 
this 'frequency' depends on the starting point of the trajectory and the 
compact set K. 

Theorem . Let K be any compact set in W 1 having a non-empty interior. 




Let 



- {w : w revisits Kfor arbitrarily large times] 
= {w : there exists a sequence t\ < ?2 < • < 00 
with t„ —> 00 such that w(t n ) € K] 



Then, 



either Q X {E*) = 0, Vx, and VK, 
or Q x {El) = \,Vx, andVK. 
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30. Behaviour of Diffusions for Large Times 



Remark. 1. In the first case lim \X(t)\ - +oo a.e. Q x , Vx, i.e. almost 
all trajectories stay within K only for a short period. 

These trajectories are called transient. In the second case almost 
all trajectories visit K for arbitrary large times. Such trajectories 
are called recurrent. 

2. If b — then Q x = P x . For the case d = 1 or d = 2 we know 
that the trajectories are recurrent. If d > 3 the trajectories are 
transient. 

Proof. 

Step 1. We introduce the following sets. 

Eq ={w: X(t, w)eK for some t > 0}, 

Ef Q = {w : X(t, w)eK for some t > t Q \, < t < oo. 



Then clearly 



Let 



n=l ( >0 



Kx) = QAEZ > \F=Xe*- 
E Q *(F\&,) = E Q *(x E K\^ t ) = Qx(»(El) 

by the Markov property, 
= .A(Z(0) a.e. Q x . 

Next we show that i]/(X(t)) is a martingale relative to Q x . For, if 

s < t, 

EHnmWs) 

= eHf\& s ) 

= Hxm 



247 



Equating the expectations at time t = and time t one gets 



iff(x) = 



if/{X{t))dQ x 



n 



if/(y)q{t, x,y)dy, 



where q(t, x,A) = Q x (X t € A), VA Borel in R d . 

We assume for the present that i[r(x) is continuous (This will be 
shown in Lemma@]in the next section). By definition < if/ < 1. 

Step 2. if/(x) = 1, Vx or ^(x) = 0, Vx 

Suppose that ^(jcq) = for some xq. Then 



As q > a.e. and i/r > we conclude that \p(y) - a.e. (with respect to 
Lebesgue measure). Since if/ is continuous \p must vanish identically. 

If tj/(xo) = 1 for some xq, we apply the above argument to 1 - iff 
to conclude that if/ = 1, Vx. We now show that the third possibility 
< if/{x) < 1 can never occur. 

Since K is compact and if/ is continuous, 



From an Exercise in the section on martingales it follows that 



<K*o) = QxoiEJ = Q Xo {w : w(t) e K for arbitrary large time) 

^ Qx {w : a < if/(X(t, w)) < b for arbitrarily large times) 
< fi.v> : (1 - b)a < ifKX(tW ~ >KX(t)] < b{\ - a) 
for arbitrarily large times) 




< a = inf if/{y) < sup if/(y) = b < 1 . 

)' eK yeK 



if/(X(t)) Xe k a - e - Qx as ? -» +oo. 



Therefore lim if/(X(f))(l - if/(X(f))) = a.e. Q x . Now 



248 



30. Behaviour of Diffusions for Large Times 



= 0. 
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Thus if/(x) - identically, which is a contradiction. Thus for the 
given compact set K, 



Step 3. If Q X {EJ) = 1 for some compact set K (K ± 0) and Vx, then 
Q X (E^) = 1, V compact set K with non-empty interior. 

We first given an intuitive argument. Suppose Q X (E^) = 1, i.e. 
almost all trajectories visit Kq for arbitrarily large times. Each time a 
trajectory hits Kq, it has some chance of hitting K. Since the trajectory 
visits A"o for arbitrarily large times it will visit K for arbitrarily large 
times. We now give a precise arguent. Let 



either Q X (E*) = 0, Vx, 
or Q X (E* ) - 1, Vx. 



O 



T - infU : X(t) € ^ } 

ti = inf{? > t + 1 X(t) e ^ } 



t„ = mf{t > t n -i + 1 : X(t) e K ] 



Clearly tq < Ti < . . . < and r n > n. 

QAEl) > Q x [X(t) eK for t>r n ) 



CO 



>Q x {X(t)eK for te{J[Tj,T j + \]} 
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We claim that 



Q x (f~)X(T j + \)tK) = 0, 



}>n 

so that Q X (E„) - 1 for every n and hence Q X (E^) - 1, completing the 
proof of the theorem. 
Now 

q(l, x, K) > q(l, x, K) > 0, Vx, K interior of K. 
It is clear that if x n — > x, then 

o o 

limg(l,x n ,.£) > 

o 

Let d - inf q(l, x, K). Then there exists a sequence x n in Kq such 

o 

that d = Lt ^(l,x„,^). being compact, there exists a subsequence 

«— >oo 

y n of x„ with y n — > x in A'o, so that 

O 

d - lim g(l,x,,K) - ]imq(\,y n ,K) > q(\,x,K) > 0. 



Thus 



Now 



inf q(l,x,K) > d > 0. 



r N 



l]x(Tj + l)tK\J? TN 



\j=» 

N-l 



= Y\x(X(Tj + 1) t K)Q x (X(t n + 1) € K\& TN ) because 



Tj + 1 < tat for 7 < iV, 



iV-l 
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Markov property, 



N-l 



7=1 



Therefore 



( N 



f)X(T j + l)tK 



\J=n 



= EQ*{Q x ((]x{Tj + \)tK\ TN ))) 



j=n 



N-l 



[}(X[x(T j+ i)mMhX(T N ),K c ) 



\J=n 



Since Kq is compact and X(tn) e Kq, 

q(\,X(T N ),K c ) = 1 - q(\,X(T N ),K) <\-d 

Hence 



N 



f)x(T j + l)tK 



\J=n 

Iterating, we get 

( N 



(N-l 



< (1 - <DQ> 



pi x(tj +\)tK 



\j=» 

Let N — > oo to get 



<(l-d) N - n+l , V/V. 



f)x(Tj + \)tK 



\J=n 



= 0, 



since < 1 - d < 1 . Thus the claim is proved and so is the theorem. □ 
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Corollary . Let K be compact, K + 0. Then Q X (E^) - 1 if and only if 
Q x (E*) = l,Vx. 

Proof Suppose Q X (E*) = 1; then Q X (E%) = 1 because Sup- 
pose Q X (E^) = 1, then 

Q X (E*) = EHE Q "(x E ^n)) 
= E Q *(Q X{n) (E*)) 
= E Q '(l) 
= 1, V«. 

Therefore Q X (E*) = 1. □ 
Remark. If Q X (E^) - then it need not imply that 

Qx{E«) = 0. 

Example. Take b = and d = 3. LEt K = Si = {x e R 3 such that 
|x| < 1}. Define 

fl, for \x\ < 1, 

^ (n) = i t 11^1 
for W>1. 

P x (£"^) * constant but P*^) = 0. In fact, P X (E$) = >p{x) (Refer 
Dirichlet Problem). 



31. Invariant Probability 
Distributions 



Definition. Let {P x } x eR d De a family of Markov process on 

Q = C([0, oo);R d ) 

indexed by the starting points x, with homogeneous transition probabil- 
ity p(t,x,A) = P x (X t € A) for every Borel set A in R d . A probability 
measure n on the Borel field of R d is called an invariant distribution if, 
VA Borel in R d . 



We shall denote dp(t, x, y) by p(t, x, dy) or p(t, x, y)dy if it has a den- 
sity. 

Proposition . Let L2 = A/2 + b ■ V with no explosion. Let Q x be the 
associated measure. If{Q x } has an invariant measure p then the process 
is recurrent. 

Proof. It is enough to show that if K is a compact set with non-empty 
interior then 



for some x. Also Q x {Ef) > Q x (X t € K) = q(t,x,K). Therefore 




Qx(E«) = 1 



//(*)= q{t,x,K)dp{x)< Q x (Ef)dp(x). 
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Now, < Q x {Ef ) < 1 and Q x (Ef) decreases to Q X (E*) as t -> oo. 
Therefore by the dominated convergence theorem 
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If the process were transient, then Q x (Eo£) - 0, Vn, where S„ = 
{x e R d : \x\ < n], i.e. fi(S n ) = 0, Vn. Therefore y«(R rf ) - 0, which is 
false. Thus the process is recurrent. 

The converse of this proposition is not true as is seen by the follow- 
ing example. 

1 d 2 

Let L - — — - so that we are in a one-dimensional situation (Brow- 

2 ox 1 
nian motion). Then 

C 1 -U-y) 2 1 
K 

where A denotes the Lebesgue measure on R. If there exists an invariant 
distribution p, then 

p(K) = f p(t,x,K)dp(x) < —7-^—A(K) f dp(x) = -^p- 

Letting t — > oo, we get p(K) = V compact K, giving p = 0, which 
is false. □ 

Theorem . Let L = A/2 + b • V with no explosion. Assume b to be 

C°°. Define the formal adjoint L* of L by L* = A/2 - V • b (i.e. L*u = 

1 , 

-Ait — V ■ (bu)). Suppose there exists a smooth function <f>{C - would 

do) such that L* <p = 0, (f> > 0, inf cpdx = 1. If one defines p by the rule 
p{A) - J <p(y)dy, then p is an invariant distribution relative to the family 

A 

{Qxl 



244 Proof. We assume the following result from the theory of partial differ- 
ential equations. 
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If / € Cq{G) where G is a bounded open set with a smooth bound- 
ary dG and / > 0, then there exists a smooth function U G : [0, oo)xG — > 
[0, oo) such that 

^ = LU G on (0,oo)xG, 

t/ G (0, x) - f(x) on |0) x G, 
U G (t, x) = 0, Vx e G. 

Let t > 0. As J7g, are smooth and G is bounded, we have 

d r r a r 

— I U G {t,x)(p{x)dx = I — U G <pds = I <f>LU G dx 

G G G 

Using Green's formula this can be written as 
| J U G (t, x)<p{x)dx = J U G L*<p - X - J - t/ G |- 

G G dG 

+ J{b- n)U G (t, x)4>{x)dS 
dG 

Here n is assumed to be the inward normal to dG. So, 
— I U G (t,x)(f>(x)dx = -- I (x)-^-(t,x)dS 

G dG 

(Use the equation satisfied by (p and the conditions on U G ). Now U G (t, x) 
> 0, Vx e G, U G (t, x) = 0, Vx in dG, so that 



dn 

This means that 



i/,f G (t,x) > 0. 



5 r 

— U G (t, x)(b(x)dx < 0, W > 0, 
at J 
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i.e. J Uc(t, x)(p(x)dx is a monotonically decresing function of t. There- 

G 

fore 

^ Uc(t, x)(f)(x)dx < ^ Ug{0, x)<p(x)dx 

G G 

= J f(x)(f>(x)dx 



J f(x)cj>(x 



)dx. 



Next we prove that if U : [0, oo)xR d [0, oo) is such that ^ = LU, 
W > and U(0, x) = f(x), then 



J U(t, x)(/>(x)dx < J 



x)(f>(x)dx < J f{x)(j>{x)dx. 

The solution Uc(t, x) can be obtained by using Ito calculus and is 
given by 

U G (t,x) = J f(X(t)) X{TG>t} dQ x . 
We already know that 

U(t,x) = J f(X(t))dQ x . 

Therefore 



Now 



Jj f(X(t)) X{TG >t}dQ x <f>(x)dx 

^ Uc(t, x)(f>(x)dx < J" f(x)(p(x)dx. 
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Letting G increase to R d and using Fatou's lemma, we get 



JJ f(X(t))<f>(x)dQ x dx < J f(x)<f>(x)dx 



This proves the assertion made above. 
Let 

yU (A) = J <f>(X)dx, 

A 

v(A) = J Q x (X t e A)dfi(x) = J q(t, x, A)d/x(x). 

Let / e Cq(G), f > 0, where G is a bounded open set with smooth 
boundary. Now 

J f(y)dv(y) = jj f(y)q{t,x,y)d/j{x)dy 
= JJ f(X(t))dQ x d/u(x) 
= ^ U(t, x)d[i(x) 
= ^ U(t, x)<p{x)dx 
< J f(x)<f>(x)dx = J f(x)d M (x). 
Thus, V/ > such that feC™, 

J f(x)dv(x) < J f(x)dfi(x). 

This implies that v(A) < /i(A) for every Borel set A. (Use mollifier 247 
s and the dominated convergence theorem to prove the above inequality 
forx4 when A is bounded). Therefore v(A c ) < y«(A c ), or 1 - //(A) < 1 - 



258 31. Invariant Probability Distributions 

H{A), since ji, v are both probability measures. This gives //(A) = v(A), 
i.e. 

//(A) = J q(t,x,A)dn(x), W, 

i.e. fi is an invariant distribution. 

We now see whether the converse result is true or not. Suppose there 
exists a probability measure on R d such that 

J Q x (X t e A)dn(x) = n(A), VA Borel in R d and W. 
The question we have in mind is whether //(A) = J <pdx for some 

A 

smooth <f> satisfying L*(f> = 0, (f> > 0, J (p(x)dx = 1. To answer this we 
proceed as follows. 

By definition //(A) = J q(t, x,A)dfi(x). Therefore 

JJ f(X(t))dQ x dfi(x) 

= ff f(y)q(t,x,y)dy dn(x) 

(l) = J f(yW(y)Vf e C^rt/IL < l. 

Since X is an Ito process relative to Q x with parameters b and /, 

t 

f(X(t)) - J (Lf)(X(s))ds 
o 

248 is a martingale. Equating the expectations at time t = and time t we 
obtain 

E&(f(X(t)) = f{x) + | J {Lf){X{s))ds 
Integrating this expression with respect to [i gives 

JJ f{X{t))dQ x d^{x) = J f(x)dfi(x) JJ J (Lf)(X(s))ds dQ x d/u. 
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Using (1), we get 

R d a o 

Applying equation (1) to the function Lf we then get 

t 

= J J (Lf)(y)d/u(y)ds 

^ 

= t J (Lf)(yW(y), Mt > 0. 

R d 

= f(Lf)(y)d»(y), \ffeC™(R d ). 



Thus 



In the language of distributions this just means that L*/i = 0. 
From the theory of partial differential equations it then follows that 
there exists a smooth function <f> such that VA Borel in R d , 

H(A) = J <f>(y)dy 

A 

with L*(p - 0. As /i > 0, <p > and since 



p(R d ) = 1, J <f>(x)dx = 1. 



We have thus proved the following (converse of the previous) theo- 
rem. 

Theorem . Let /i be an invariant distribution with respect to the family 
{Q x \ with b:R d -^R d being C°°. Then there exists a<pe L'(R d ), cf>>0, 
smooth such that 



L*<p = 0, 
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and such that 

/j(A) = J <pty)dy, VA Borel in R d . 

A 

Theorem (Uniqueness). Let <p\, be smooth on R d such that 



0i,02 > 0, 1 = J (pidy = J <j> 2 dy,L*<pi = = L* 

R d R d 

Then (pi = (pi- 
Proof. Let f(x) = (pi (x) - </> 2 (x), 

Hi(A) = J (pi(x)dx, i- 1,2. 

A 

Then m, and [i 2 are invariant distributions. Therefore 

J q(t,x,y)(pi(x)dx = J q(t,x,y)dm(x) 

= 4>i(y), (a.e.), i = l,2. 
Taking the difference we obtain 



<Pi- 



J q(t, x, 



y)f(x)dx = f(y), a.e. 



Now 



J \f(y)dy = J | J q(t,x,y)f(x)dx\dy 
~ If q(t,x,y)\f(x)\dxdy 
= J \f(x)\dx J qit, x,y)dy 
= J \f(x)\dx. 



Thus 



(*) 



II 



\f(x)\q(t, x,y)dx dy 



y)f(x)dx\dy Vf . 



We show that / does not change sign, i.e. / > a.e. or / < a.e. 
The result then follows from the fact that J f(x)dx - 0. Now 

I J" q(l,x,y)f(x)dx\ < J q(\,x,y)\f(x)\dx 
and (*) above gives 

J \j q(\,x,y)f(x)dx\dy = jj q(\, x,y)\f(x)\dx dy. 



Thus 



i.e. 



I J" q(l,x,y)f(x)dx\ = J q(\,x,y)\f(x)\dx a.e. y, 
\f q(l,x, y)f(x)dx + J q(\,x, y)f(x)dx\ 

E- E~ 

- J q(\, x,y)f(x)dx - J q(\, x,y)f(x)dx a.e. y, 



where 



E + = {x: f{x) > 0}, E~ = [x : f(x) < 0}, E° = {x : f(x) = 0}. 
Squaring both sides of the above equality, we obtain 



(**) \J q{l,x,y)f{x)dx J q(\,x,y)f(x)dx 



= 0, a.e. y. 
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Let A be a set of positive Lebesgue measure; then p(\,x,A) - 
P X (X(\) e A) > 0. Since Q x is equivalent to P x on Q. we have Q X (X(\) e 
A) = q(l,x,A) > 0. Therefore q(l,x,y) > a.e. y for each x. By 
Fubini's theorem > a.e. x, y. Therefore for almost all y, 

q(l,x,y) > for almost all x. Now pick a y such that (**) holds for 
which q{\,x,y) > a.e. x. 

We therefore conclude from (**) that either 

J ' q(\,x,y)f(x)dx = 0, in which case / < a.e., 

E+ 



or 

J" q{\,x,y)f(x)dx = 0, in which case / > a.e. 

e- 

Thus / does not change its sign, which completes the proof. □ 



Remark. The only property of the operator L we used was to conclude 
q > 0. We may therefore expect a similar result for more general opera- 
tors. 

Theorem . Let L*cf> - where > is smooth and J <p(x)dx - 1. Let K 
be any compact set. Then 

sup I \q(t, x,y) - 4>(y)\dy — > as t —> +oo. 

xeK J 

Lemma 1. Let b be bounded and smooth. For every f :M. d — > R d that is 
bounded and measurable let u(t, x) = E® x (f(X(t)). Then for every fixed 
t, u(t, x) is a continuous function of x. Further, for t > e > 0, 

dy\ 



< ll/ILV(^V e - l)), 



252 where c is a constant depending only on \\b\\, 



Proof. Let 
(1) 

where 



(T t f)(x) = E&(f(X(t)) = E p *{f{X{t))Z{e,t))+ 
+ E p *(f(X(t))(Z(t)-Z(e,t))), 



Z(t) = exp 



Z(e, t) = exp 



J (b\dx)-^J \b\ 2 ds 
o 

t t 



\b(X(s))\ z ds 



E p *(f(X(t))Z(e,t)) = E p *(E p x(f(X(t))Z(e,t)\ £ )) 

= E p *{E p *e){f{X{t - e))Z(t - e))) 
(by Markov property), 



= E F *(u(t-e,X(e)). 



(2) 



= J" u(t - e, 



y) 



l 



(V(27T£))< 



exp 



\(x-y)\ 2 



2e 



dy. 



Now 



(E F *(\Z(t)-Z(e,t)\)) = 

= E p *(\Z(6)Z(e,t)-Z(e,t)\)) 2 
= E p *{Z{e,t)Z{e)-\\)) 2 
<(E p *((Z(e)-\) 2 ))(E p *(Z 2 (e,t))) 
(by Cauchy Schwarz inequality), 

< E p \Z 2 {e) - 2Z(e) + l)E p "(Z 2 (e, t)) 

< E p \Z 2 {e) - l)E p "(Z 2 (e,t)), (since E p *(Z(e)) = 1), 

< E p *{Z 2 {e) - l)£ p *(exp(2 J" (b, dX) -^J \b\ 2 ds + j 



\b\ 2 
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< E p *{Z 2 {e) - l)e ct , 
253 using Cauchy Schwarz inequality and the fact that 



£ Nexp(2/<M*>-f JVto) = l. 



Thus 



E p *{\Z{i)-Z{e,t)f <{e ce -\)e ct 
where c depends only on H^IL- Hence 

\E p *(f{X(t))(Z(t) - Z{e,t))\ < \\f\UEHzit) - Z{e,t)\) 
(3) < \\f\UMe" ~ l> cf ). 

Substituting © and © in ([U we get 



\u(t, x) 



u(t - ey) 



1 



exp 



< ll/IUV((^ e - IK') 



-\x-y? 
2e 



dy 



Note that the right hand side is independent of x and as e — > the 
right hand side converges to 0. Thus to show that u(t, x) is a continuous 
function of x {t fixed), it is enough to show that 



u(t-e,y) 



1 



(V(2^)< 



exp 



■|jc-y| 



2 



2e 



dy 



254 is a continuous function of x\ but this is clear since u is bounded. Thus 
for any fixed tu(t, x) is continuous. □ 

Lemma 2. For any compact set K c R d , for r large enough so that 

K c {x : \x\ < r], x -> Q x (r r < t) 
is continuous on Kfor each t > 0, where 

T r (w) - inf{s : \w(s)\ > r). 
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Proof. Q x (r r < t) depends only on the coefficient b(x) on |x| < r. So 
modifying, if necessary, outside \x\ < r, we can very well assume that 
\b(x)\ < M for all x. Let 

T £ r - mf{s : s > e, \w(s)\ > r}. 
QM < = E Q \u{X{e))), 

where 

u(x) = Q x (r r <t-e) 

As b and u are bounded, for every fixed e > 0, by Lemma^ Q x (T r < 
t) is a continuous function of x. As 

\Qx(T £ r < t) - Q x (Tr < t)\ < Q x (j r < 6), 

to prove the lemma we have only to show that 
limit sup Q x (T r < e) = 

xeK 



Now 



Q x {T r <e)= J Z()dP x 

{r r <e} 



< ( J (Z(e)fdP x ) l/2 ■ ^P x (r r < e), 



by Cauchy-Schwarz inequality. The first factor is bounded because b is 255 
bounded. The second factor tends to zero uniformly on K because 



where 



sup P x (r r < e) < P( sup \w(s)\ > 6) 

xeK 0<i<e 



5= inf \(x-y)\. 

yeK 
\x\=r. 



□ 

Lemma 3. Let K be compact in M. d . Then for fixed t, Q x (r r < t) monot- 
ically decreses to zero as r — > oo and the convergence is uniform on 
K. 
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Proof. Let f r (x) - Q x (T r < t). As {r r < t) decreases to the null set, f r {x) 
decreases to zero. As K is compact, there exists an r$ such that for r > 
r 0> fr(x) is continuous on K, by Lemma Lemma |3] is a consequence 
of Dini's theorem. □ 

Lemma 4. Let b :W — » R be smooth ( not necessarily bounded). Then 
E^ x (f(X(t))) is continuous in xfor every fixed t, f being any bounded 
measurable function. 

Proof. Let b r be any bounded smooth function on R d such that b r = b 
on |x| < r and Q r x the measure corresponding to b r . Then by Lemma^ 
E@ x (f(X(t))) is continuous in x for all r. Further, 

\E&(f(X(t))) - EHMit)))\ < 2H/IU • QxiTr < t). 

The result follows by Lemma|5] □ 

Lemma 5. With the hypothesis as the same as in Lemma (S i ) is an 
equicontinuous family, where 

S\ = {/ : M. d — > R, / bounded measurable, \\f\\oo < 1} 

Proo/ For any / in 5 1, let £/(x) - I7(f, x) = E&(f(X(t))) and 



t/ e (x) - x) = f C/(? - e,y) - — - exp 

(V(27re) d ) 



By Lemma [2 



-|x-y| 2 



2e 



<iy. 



|[/(x)-[/ e (x)|<(((^-l)e ff )) 1/2 
\U(x) - U(y)\ < \U(x) - U £ (x)\ + \U £ (y) - U(y)\ + |t/ e (x) - U e (y)\ 
<2^{{e ce -\)e ct ) + \U € {x)-U £ (y)\. 



The family { U £ : / € S i ) is equicontinuous because every U occur- 
ing in the expression for U e is bounded by 1 , and the exponential factor 
is uniformly continuous. Thus the right hand side is very small if e is 
small and |x - y\ is small. This proves the lemma. □ 
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Lemma 6. Let b be smooth and assume that there is no explosion (b 
is not necessarily bounded). Then (S i ) is an equi-continuous family 
Vf > 0. 

Proof. Let r > be given. Define b r € C°° such that b r = on |x| > r+1, 
b r - b on \x\ < r, b r : R d — > R. By Lemma|2 we have that 

{£«(/(X(0)) :/€5i) 

is equicontinuous, where <2^ is the probability measure corresponding 257 
to the function b r . 

(1) £ e 1/W0k( Tr >r])£ K (/(^(f)k(r r >rl). 
Therefore 

\E&(f(X(t))) - E^(f(X(t))\ 
= \E Q *{W{t))X\T r >,\) + EHW{t))X\T r < t] ) 
- E&(f(X(f))x {Tr >t}) ~ E Q <{f{X{t)))X\r r <t\) 
= \EHW{t)X\r r <t}) ~ E Q >(f(X(t)) X{ T r < t] )\ 
<ll/IU(£ ei Cr(r r <r)) + £ K Cr ( r r <r)) 
< l[E Q *(x( Tr <t)) + £ & CT(r r <o)](use (1) with / = 1) 
= 2E^(x (Tr <t))- 

Thus 

sup sup \E Q *(f(X(t)) - E Q kf(X(t))\ < 2su V (X{r r <t}). 

xeK\\f\\„<\ xeK 

By Lemma|21 

sup£ 0l (T r < f) 

xeK 

for every compact set K as n — > oo, for every fixed 

The equicontinuity of the family (S i) now follows easily. For fixed 258 
x , put u r (x) = E&(f(X(t))) and u(x) = E&(f(X(t))) and let A" - 
s[xo, 1] = {x : \x - xo\ < 1}. Then 

\u(x) - u(xq)\ < \u(x) - u r (x)\ + \u(xq) - u r (xo)\ + \u r (x) - u r (xo)\ 
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< 2 sup E Q y(x(j r <\t)) + KO) - u r (xo)\ 

yeK 

By the previous lemma {u r } is an equicontinuous family and since 
sup E Q y(x( Tr <i)) — > 0, {u : H/Hoo < 1} is equicontinuous at xq. This 

proves the Lemma. □ 

Lemma 7. T r o T, = r f+i , Vs, r > 0. 

Remark. This property is called the semigroup property. 

Proof. 

T r {T s f){x) 

= f{z)q{s,y,z)q{t,x,y)dy dz. 
Thus we have only to show that 

J q(t, x, y)q(s, y, A)dy = q(t + s, x, A). 

q(t + s, x, A) = E Q *(X(t + s) e A) 
= E°*(X(t + s)e A\ t )) 
= E & (E Q *X(t)(X(s) e A))), 

by Markov property 
= E & (q(s,X(t),A)) 

= J q(t,x,y)q(s,y,A)dy, 

which proves the result. 

As a trivial consequence we have the following. □ 

Lemma 8. Let e > and let S i be the unit ball in B(R d ). Then \J T t (S i) 

t>£ 

is equicontinuous. 
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Proof. U r,(5i) = r(U^(5i))(byLemma0r e (5i). 



t>£>0 t>0 

The result follows by Lemma^ 



□ 



Lemma 9. Let u(ttx) = E Q *(f(X(t))) with U/1L < 1. Let e > be given 
and K any compact set. Then there exists a Tq = 7o(e, K) such that 
Vr > To and Vx\, X2 € K, 



Proof. Define q*(t,x l ,x 2 ,yi,y2) - q(t,x x ,y x )q{t,x 1 ,yi) and let Q (xuXl) 
be the measure corresponding to the operator 



Then Q( XuX2 ) will be a measure on C([0, oo); R d x R d ). We claim that 
Q(x u x 2 ) = Qx, x Q X2 . Note that 

C([0, oo); R d x R d ) = C([0, oo); R rf ) x C[(0, oo); R rf ) 

and since C([0,oo);R d ) is a second countable metric space, the Borel 260 
field of C([0, oo)R d x R d ) is the cr-algebra generated by 



By going to the finite-dimensional distributions one can check that 



\u{T,x\) - u(T,X2)\ < e. 



L = — (A Vl + A X2 ) + b(x x ) ■ V Xl + b{x 2 ) ■ V. 
i.e., for any icR^xl^ R, 



Lu - — 




3$ = (C([0, oo); R d )) x ^(C[0, oo); R d ). 





exp 



x 



LO 
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261 



x exp 







where 



b (1 \x { ...x d ) = b(x\ ...,x d )- b (2) (x d+i . . . x 2d ) = b(x d+ i, x 2d ), 

so that Q( XuX2 ) = Q X i x Q X2 . 

It is clear that if (p defined an invariant measure for the process Q x 

i.e. 



^ </>(x)dx - ^ 



4>(y)Qy(x t € A)dy, 



then <f>(y\)<p(y2) defines an invariant measure for the process Q( Xi ,x 2 )- 
Thus the process Q( Xl ,x 2 ) i s recurrent. 

Next we show that u(T - 1, X\(t)) is a martingale (0 < t < T) for any 
fixed Ton C([0, T];R d ). 

E & {u{T -t,X{f)\& s )) 
= [J u(T - t, y)q(t - s, x, dy)] x=X ( s ) 

= iff f(z)q(T - t,y, dz)q{t - s, x, dy)] x=X ( s ) 

= [ j fiz)q{T - s,x,dz)] x =xu) 
= u(T - s,X(s)), s<t. 



It now follows that u(T - t, Xi(t)) is a martingale on C([0, oo); W) x 
C([0,oo);R rf ). Hence u(T - t,X { (t)) - u(T - t,X 2 (t)) is a martingale 
relative to Q(x uX2 y 

Let V = S(0, 6/2) c R d x R d with 6 < 1/4. If (x u x 2 ) e V, then 



|xi - x 2 \ < \(x u 0) - (0, 0)| + |(0, 0) - (0, x 2 )\ < 6. 



□ 
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Claim 1. Q(xi,x2)i T v < — > 1 as T — > oo, where Ty is the exit time 
from R d - V. 

Proof. If w is any trajectory starting at some point in V, then ry = 
< T, Vr. If w starts at some point outside V then, by the recurrence 
property, w has to visit a ball with centre and radius 6/2; hence it must 
get into V at some finite time. Thus {ry < T} f to the whole space as 
T t 00 • Next we show that the convergence is uniform on compact sets. 

If x\, x 2 £ K, (xi,X2) e K x K (a compact set). Put gr(*i,X2) = 
2(*i,je 2 )( t v - Then gr(^i> ^2) ^ and gr(xi, xi) increases to 1 as T 
tends to 00. 

g T (Xl,X2) = Q(x u x 2 )(Ty < T) 

Q( Xl , X2 )(Ty < T), 

where 

r^ = inf{?> 1 : (x l ,x 2 )eV). 

Therefore 

g T (Xl,X 2 ) > E Q (X U X 2 )(E Q (X U X2)((T V < T)\i)) 

= £ e (x 1 ,x 2 )(G (Xl(1) , X2(1)) {r y < T)}) 
= EQ{x l ,x 2 ){ilj T {X l {\),X 2 {\))), 

where ipj is a bounded non-negative function. Thus, if 

h T (x u x 2 ) = Q( XuX2 )(Ty <T) = 

-£ e (x 1 ,x 2 )(«A r (X 1 (l),X 2 (l))), 

then by Lemma|3J hj is continuous for each T, gj > hj and hj increases 
to 1 as T — > 00. Therefore, hj converges uniformly (and so does gj) on 
compact sets. 

Thus given e > chose Tq - To(e, K) such that if T > To, 
sup sup Q( XuX2) (t v > T - 1) < e. 

x 2 eK x\eK 
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By Doob's optional stopping theorem and the fact that 

u(T - t,Xi(t)) - u{t - t,X 2 (t)) 

is a martingale, we get, on equating expectations, 

\u(T, x\) - u(T, x 2 )| 

= \E Q '^'2>[u(T - 0,^(0) - u(T - 0,X 2 (0)]| 
= \E Q ^2>[u(T - (t v A (T - VIXiiT - ( Tv A (T - 1))- 
- u(T - (t v A T(-1)),X 2 (T - (t v A (T — 1)]| 

| J [ M (l,X 1 (l))- M (l,X 2 (l))]Je fa ^ 2) + 
{T v >r-D 

+ J [M(r-T v ,x 1 (r-T v ))- M (r-T v ),x 2 (7;-T v ))Je ta ,, 2) |. 

(r v <(r-D) 
Therefore 

|h(t\ xO - w(r,x 2 )| 
< 



{T v <(r-D) 



J |[«(l,Xi(l)) - u(l,X 2 (l))]\dQ (Xl , X2) + 

r v >(T-l)} 

J [«(r - t v , x x {T - t v )) - «(r - Tv, x 2 (r - Tv))^,,^! 

(T-l)} 

< 2e+ | J - T v ,X t {T - n,)) - u(T - t v ,X 2 (T - T v ))]dQ (xuX J, 

(t v <(T-1)) 

since u is bounded by 1 . 

The second integration is to be carried out on the set {T - v > 1}. 

Since 1J T t (S i) is equicontinuous we can choose a 8 > such that 

f>i 

whenever x\, x 2 e K such that |jci - x 2 \ < 5 

\u(t, xi) - u(t, x 2 )\ < e, W > 1. 

264 

Thus \u(T,x\) - u(T,x 2 )\ < 3e whenever x\, x 2 e K and T > Tq. 
This proves the Lemma. □ 
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Corollary to Lemma|9j sup J \q(t, x\ , y)\dy converges toOas t — > oo. 
Proof. Since the dual of L 1 is L°°, we have 

f |^,xi,y) - #(f,x 2 ,y)k*y 

= sup | \ [q(t,xuy)-q(t,xz,y)]f(y)dy\ 
IWU<1 J 

and the right side converges to as t — > oo, by Lemma|5| 

We now come to the proof of the main theorem stated before Lemma 
□ Now 

J \q(t,x,y)-<P(y)\dy 

- J \q(t,x,y)~ J (p(x l )q(t,x\y)dx l \dy 

(by invariance property) 

- ^ | J" q(t,x,y)(p(x l )dx [ - J" (p(x [ )q(t,x l ,y)dx l \dy 

(since J <p(x l )dx l = 1) 
< ^ \q(t, x, y) - q(t, x l , y)\<p(x l )dx l dy (since (p > 0) 
= J (pix^dx 1 J\q(t,x,y) - q(t,x l ,y)\dy 



Since 



f <p{x l )dx l = Lt f (p(x l )dx\ 



|x> |<n 

choose a compact set L K such that J <f>{x l )dx l < e. Then 

R d -L 

J ' <p(x l )dx l ^ \q(t, x,y) - q(t, x l ,y)\dy 
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= J" (f>(x i )dx l J"\q(t,x,y) - q(t,x l ,y)\dy+ 

L 

+ J (f>(x l )dx l J \q(t, x, y) - q(t, x l , y)\dy 

fL d -L 

< N (f>(x l )dx l f \q(t,x,y) - q(t,x l ,y)\dv + 2e. 



L 

Chose to such that whenever t > to, 



J \q(t, x, y) - q(t, x l , y)\dy < — 



+ J 4>(x l )dx l 

L 

Vx, xi in L. (Corollary to Lemma|51). Then 

J \q{t,x,y)-<p(y)\dy <3e, 
if t > toix e K completing the proof of the theorem. □ 
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Theorem . Let f :M. d — > Rbe bounded and measurable with \\f\\oo < 1. 266 
If (f> is an invariant distribution for the family {Q x }, X € W 1 then 



lim E Q *(f(X(h))f(X(t 2 ))) = [ f f(y)<p(y)dy] 2 

0<f2-?l— >°° 

Proof. 

EH(f(X(h)f(X(t 2 ))] 
= E Q *(E Q <[f(X(h))f(X(t 2 ))\^ tl ]) 
= E Q *(f(X(h))(E & [f(X(t 2 ))\^ tl ])) 

= E & (f(X(h)) J f(y)g(t 2 - h,X(ti),yy)dy),t2 > h 

(by Markov property), 
(1) = J f(z)q(h,x,z)dz J f(y)q(h-h,z,y)dy 
does any bounded an measurable /.By theorem of § I3T1 



sup I I 

xeK J 



f(y)[q(t,x,y)-<p(y)]dy\^0 

as t — > +oo. We can therefore write Q in the form 
EH(f(X(h))f(X(t 2 ))] = 

= ( J f(z)q(t y , x, x)dz) J f<p + J f(z)q{h , x, z)A(t 2 - t y , z)dz, 
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where A(f 2 -/i,z) converges to (uniformly on compact sets as) t%—t\ — > 
+oo. 

To prove the theorem we have therefore only to show that 
J f{z)q{t\ , x, z)A(t 2 - h , Z)dz -» 
as t\ — > +oo and f 2 - ?i — > oo (because f f(z)q(t\, x, z)dz — * J f<f>). Now 
| /(z)^i,x,z)Afe -t u z)dz\ 
< ll/IU J ^i,x,z)|A(f 2 - fi,z)kfe 
(2) < J~ q{h,x,z)\A(t 2 -h,z)\dz 

Let ^ be any compact set, then 

J q(h,x,z)dz = J XKq{t\,x,z)dz -> J" XK<p{z)dz 

K 

at ?i — > oo. Given e > 0, let be compact so that 

| J x K c<P(z)dz\ < e, 
then | fxK c q(ti , x, z)dz\ < 2e if t\ » 0. Using © we therefore get 
| f /(zM?ix,z)A(f 2 -fi,z>fe| 

< r^i,x,z)|A(f 2 - fi,z)|ffe + f ?(fi,x,z)|A(f 2 ~/i,z)|dz 

a: £ r 

< J q(t\ , x, z)\A(t 2 - h , z)\dz + 2 J q(t\ , x, z)dz, 



K K c 

since |A(f 2 - t\,z)\ < 2, 



< J q(h,x, 



z)|Afe - fi,z)|<fe + 2e, if fi » 0. 
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268 The theorem now follows from the fact that 



lim sup \A(t2 - h , z) - 0. 

t 2 - tl -^oo z£K 



Weak Ergodic Theorem. 



lim E Q * 

t—>oo 



- t J f(X(s))ds - f(x)ct>(x)dx\ > e 
o 



-0. 



Proof. 



\- t J f(X(s))ds- J f(x)<p(x)dx\ 



> € 



\- t ff(X(s))ds- J/(v)0(v)</v| 2 



by Tchebychev's inequality. We show that the right side — > as t — > oo. 
Now 



|y ff(X( S ))ds- JjJ,\- 



fixio-^fixi^do-x do-2 + ( fWy) 





t 



Also 



- 2- t J f(X(cr))do- J fcpdy] 
o 



sup \EHf(X(t))- f f(y)<p(y)dy]\ 

xeK J 
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= sup| I q(t,x,y)f(y)dy- I f(y)<p(y)dy\ 

xeK J J 

< 1 1/| loo sup I \q(t,x,y) - <p(y)\dy; 

xeK J 

269 the right hand side tends to as t tends to +oo. Consider 
WH\ J f(X(cr))dcr - J f(y)<f>(y)dy)\ 



o 

= \E Q *\- t J f{X{cr))dcr- J f(y)<f>(y)dy + ± J f(X{a))da 

V * 

T 

<y|J EQ'f{X{a))d(T-T j f(y)cf>(y)dy\+ 
o 

+ \E Q \- f j f{X{a))da-{*-^-} j f(y)4>(y)dy 

V T 

Given e > choose T large so that 

\EHf{X{(T)) - J f(y)<p(y)dy\ < e, {cr > T). 

Then 

t 

\E Q \\ J f(X(o-))dcr - J f(y)<p(y)dy\ < 
o 

T 

< |I J EHf(X(cr))] -jf f(y)<p(y)dy]\ + *-^e 

o 

< 2e 

provided t is large. Thus 

t 

lim f /(X(cr))J(r] = f f<pdy. 

t^+°° t J J 



, < T < t , 



279 



To prove the result we have therefore only to show that 



/ t t 



lim E Q * 

t—>+co 



V / 



2 




OB = AB = t 



POR is the region cr 2 > to, <T\ - cr 2 > to. 
Let/ 



= E & 



iff 



f{X{<r x ))f{X{<r 2 ))d(rido-2 



o o 



= | ^Hf{X{o-i))f{X{<r 2 )))-ly§ f(y)<f>(y)dyj ]<fo-iAr 2 

< cr 2 < 0"i < t. 
Then 

|/|<| J |£ & (/(X(o-i))/(X(cr2))) - (J/WO'My) \d<r x da 2 

APQR 



270 



280 



32. Ergodic Theorem 



+ - ■ 2\\f\\i [area of OAB - area of PQR] 

By the Ergodic theorem the integrand of the first term on the right 
can be made less than e/2 provided to is large (see diagram). Therefore 

m < i.l area oi pqr + ^ m i 
s | + ™£ [4 „ _ 4 , Sl . 

< e 

if t is large. This completes the proof of the theorem. □ 



(t - 2to) 



33. Application of Stochastic 
Integral 



LET b BE A bounded function. For every Brownian measure P x on 272 
£1 = C([0, oo); R d ) we have a probability measure Q x on (Q, 

Problem. Let q(t, x,A) - Q x (X t e A) • q(t, x, •) is a probability measure 
on R d . We would like to know if q(t, x, •) is given by a density function 
on E. d and study its properties. 

Step (i). q(t, x, •) is absolutely continuous with respect to the Lebesgue 
measure. 

For, p(t, x,A) = P x (X(t) e A) is given by a density function. There- 
fore p(t, x, •) » rrid (Lebesgue measure). Since 



Step (ii). Let q(t, x, y) > be the density function of q(t, x, •) and write 
pit, x,y) for the density of pit, x, •). Let 1 < a < oo. Put 



Q x « P x on & t 



q(t,z,-) < M d on^ t . 



r(t,x,y) 



q{t,x,y) 
pit, x,y) 





r a pdy x 
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a-l/a 



273 Step (iii). 



x (/>'*)■ 

Qx(X(t) € A) = J q(t,x,y)dy 

- J r(t,x,y)p{t,x,y)dy 
= J r(t,x,y)P x (X t edy). 



Therefore 



Therefore 



dQ x 



dP x 



= r(t,x,y) 



pdy 



dQ x 



dP, 



a 2 ,P x 



< 


dQ x 




a 




dP x 


t 


a 2 ,P x 



, since &\ c & u 



{E p *[Z{t) a ]} 1/a 



2 

= {E p *[exp(a 2 J (b,dX) - y j \b\ 2 ds)]\ l/a 

o o 

t t t 

/4 r* 4 2 /~* 

(MX)-y J |&| 2 ^+^y^- J |&| 2 <fc)]} 1/a , 



i.e., 







1 


(J>P*)"V 




exp 






V 



a 4 - a 2 r a 4 r 

— - — ct + a 2 \{b,dX)-— I |2>| 2 d,s \ 
o o /JJ 



where c is such that |ft| 2 < c. Using Schwarz inequality we then get 



r 2 V /a 

r a pdy < 



exp 



4 2 
<2 - CC 



-Ct 



I /a 
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Hence 



J q a dy< 



exp 



4 2 "IX 1 /" 

a —or 1 




J* pa+l 



dy 



a-l/a 



Significance. Pure analytical objects like q(t,x,y) can be studied using 
stochastic integrals. 
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Appendix 

Language of Probability 



275 Definition. A probability space is a measure space (Q, SB, P) with P(fl) 
- 1. P is called a probability measure or simply a probability. Elements 
of SB are called events. A measurable function X : (O, SB) — > Z? 6 ' is 
called <i-dimensional random variable. Given the random variable X, 
define F : R rf -> R by 

. . . a„)) - P{w : X,-(w) < a,-, for i - 1,2,..., d\ 

where X - (X\,X2, ■ . . ,Xj). Then F is called the distribution func- 
tion of the random variable X. For any random variable X, J X dP = 
( f X\dP, . . . , J XjdP), if it exists, is called mean of X or expectation of 
X and is denoted by £(X). Thus E(X) = / XJ/ 5 = p. E(X n ), where 
X" = (iq,X», . . . ,X%) is called the mome/i/ about zero. - p) n ) 
is called the « th central moment. The 2nd central moment is called vari- 
ance and is denoted by <x 2 we have the following. 



Tchebyshev's Inequality. 

Let X be a one-dimensional random variable with mean and variance 
p. Then for every e > 0, P{w : \X(w) - p\ > e) < cr 2 /e 2 . 

Generalised Tchebyshev's Inequality. Let / : R -> R be measurable 
276 such that f(u) = f(—u), f is strictly positive and increasing on (0, oo). 
Then for any random variable X : Q — > R, 

P(w : |X(w)| > e) < - 
/(f) 

for every e > 0. 

For any random variable X : O — > R d , (p{t) - E(e" x ) : R d — > C is 
called the characteristic function of X. Here ? - (t\,. . . ,td) and fX - 

?lXi + ?2^2 + • • • + ^Xrf. 
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Independence. Events E\,...,E n are called independent if for every 
{?!,..., 4} c {1, 2,..., n] we have 

P(£i, n . . . n = P(E h )P(E h ) . . . P(E h ). 

An arbitrary collection of events {E a : a e /} is called independent 
if every finite sub-collection is independent. Let {2£ a : a e /} be a 
collection of sub-cr-algebras of 2$. This collection is said to be inde- 
pendent if for every collection \E a : a e /}, where E a € & a , of events 
is independent. A collection of random variables {X a : a e 1} is said 
to be independent if {cr(X a ) : a e /} is independent where cr{X a ) is the 
cr-algebra generated by X a . 

Theorem . Let X\, X2, ■ ■ ■ , X n be random variables with Fx x , - - ■ , Fx n 
as their distribution functions and let F be distribution function ofX- 
{X\ , X n ), (f>Xi , <Px n the characteristic functions ofX\,...,X n and 
(p that of X — {X\ , X n ). Xi,...,X n are independent if and only if 
F((ai, a„)) = Fxi (a\ ) . . . F Xn (fln)for all a\, . . . ,a„, iff <p((h t„)) 
= (p Xi (h)... (/>x n (t n )for allti,..., t n . 277 

Conditioning. 

Theorem . Let X : (CI, 2$, P) — > M. d be a random variable, with E(X) 
finite, i.e. ifX- (X\, . . . ,Xd), E(X{) is finite for each i. Let % be a sub- 
a-algebra of 2$. Then there exists a random variable Y : (Q., e rf) — > R d 
such that J YdP = J XdP for every C in c €. 
c c 

If Z is any random variable with the same properties then Y = Z 
almost everywhere (P). 

Definition. Any such Y is called the conditional expectation ofX with 
respect to ^ and is denoted by E(X(€). 

If X - xa, the characteristic function of A in 2%, then E(xa\^) is 
also denoted by P(A|^). 

Properties of conditional expectation. 



1. £(1|^) - 1. 
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2. E(oX + bY\1f) = aE(X\<r?) + bE{Y\ c €) for all real numbers a, b and 
random variables X, Y. 

3. If X is a one-dimensional random variable and X > 0, then 
E(X\tf) > 0. 

4. If Y is a bounded <?f -measurable real valued random variable and 
X is a one-dimensional random variable, then 

E(YX\<<f) = YEiXXtf). 

5. If Q} c c SB are cr-algebras, then 

E(.E(X\tf)\g>) = E{X\3>). 

6. / \E(X\9)\d{P\9) < j E{X\ c €)d{P\ c €). 
n a. 

Exercise 1. Let (Q., Si, P) be a probability space, "rf a sub-cr-algebra of 
S3. Let X(t, -)Y(t, •) : Q. -> R be measurable with respect to ^ and ^ 
respectively where t ranges over the real line. Further let E(X(t, = 
Y(t, ■) for each t. If / is a simple "rf -measurable function then show that 

J X(f(w),w)d(P\V) = J Y(f(w)w)dP 
c c 

for every C in "if. 

[Hint. Let A\,...,A n be a "?f -measurable partition such that / is con- 
stant on each A,-. Verify the equality when C is replaced by C n A;.] 

Exercise 2. Give conditions on X, Y such that exercisers valid for all 
bounded "^-measurable functions and prove your claim. 

The next lemma exhibits conditioning as a projection on a Hilbert 
space. 

Lemma . Let (Q,, S3, P) be any probability space ^ a sub-cr-algebra of 
S3. Then 



287 



(a) L 2 (Q, P) is a closed subspace ofL 2 (Q, SB, P). 

(b) If n : L 2 (Q,S$,P) -> L 2 {Q.,^,P) is the projection,then n(f) = 

Proof. (a) is clear, because for any / e L l (Q., c &, P) 

J fd(PW) = J fdP 
n n 

(use simple function < si <...</, if f> 0) and L 2 (Q, <g , P) 279 
is complete. 

(b) To prove this it is enough to verify it for characteristic functions 
because both n and / — > E{f\ c to) are linear and continuous. 

Let A € 38, C € ^ then n(xc) - Xc- As n is a projection 
J 7t(xA)Xcd(Pm = J XArtx7)d(P\m, 

i.e. 

J n(x A )d(P\m = J X A d(P\3B). 
c c 

Since ti(xa) is "^-measurable, 



J n(xA)d{P\S8) = J n(x A )d(P\tf) 



c c 

Therefore 



J n(XA)d(P\tf) = J X Ad{P\m, VC in . 



Hence 



k(xa) = E(xaW). 



□ 
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Kolmogorov's Theorem. 

Statement. Let A be any nonempty set and for each finite ordered subset 
(t\ , ?2, - - - , t n ) of A [i.e. t n ) an ordered «-tuple with t[ in A], let 

280 P(t u ...,t n ) be a probability on the Borel sets in R dn = R d x R d x ■■■R d . 
Assume that the family P( tl ,...,t„) satisfies the following two conditions 

(i) Let t : {1,2, ... ,n) — > {1, 2, ...,n] be any permutation and f T : 

R dn _^ R dn be giyen by 

f T ((xi, . . . , X n )) - U T (1), . . . , x T{n) ). 

We have 

(E) =P (h ,...,M- l (E)) 

(t T {\),-Mn)) 

for every Borel set E of /? dn . In short, we write this condition as 
Pn = P t T- i . 

(ii) P (E) = P( tlA ,.. Mn+l ,...t H+m) (ExR dm ) for all Borel sets E of R dn 

(fi ,...,**) 

and this is true for all *i, . . . , t n , t n+ i, t n+m of A. 

Then, there exists a probability space (O, P) and a collection of 
random variable {X t : t e A] : (O, — > 7? d such that 

/> (£) = P{w:(X fl (w),...,X f >))e£} 
for all Borel sets £ of 

Proof. Let O = 7r{/?f : t e A} where /?f = for each t. Define 
X ( : O — > R d to be the projection given by X t (w) - w(t). Let 33$ be 
the algebra generated by {X t : t e A) and ^ the cr-algebra generated by 
{X ( : t € A}. Having got Q and ^ we have to construct a probability P 
on (Q, satisfying the conditions of the theorem. 

281 Given t\ , . . . , t n define 

%!,...,,„) : Q.^ R d xR d x---x R d (n times) 
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by 

%!,...,r„)(wO = (w(h), w(t n )). 

It is easy to see that every element of 3§q is tt! 1 f AE) for suitable 
t\,...,t n in A and a suitable Borel set E of R dn . Define P on 3§q by 
P{n~^ (n) (E)) = P( tu ...,t n )(E). Conditions (1) and (2) ensure that P is 
a well-defined function on 3§q and that, as P( tu ...,t„) are measures, P is 
finitely additive on SSq. □ 

Claim. Let Ci 3 C2 3 . . . D C„ 3 . . . be a decreasing sequence in SSq 
with limit P(C„) > £ > 0. Then nC„ is non-empty. Once the claim is 

n— >oo 

proved, by Kolmogorov's theorem on extension of measures, the finitely 
additive set function P can be extended to a measure P on SS. One easily 
sees that P is a required probability measure. 

Proof of the Claim. As C n e SSq, we have 

c n = n~L (n) (E n ) for suitable tf> in A 

[ h '-''kitty 

and Borel set E n in Let 

T n = <$>,..., and A„ = {^,...,^ )} . 

We can very well assume that A„ is increasing with «. Choose a compact 282 
subset E' n of such that 

P Tn (E n -E' n )<6/2 n+1 . 

If C; - n-\E' n ), then P(C„-C;) < 5/2" +1 . If C; = C\nC' 2 n. . .nC' n 
then C," <zC' n <zC n , C'^ is decreasing and 

n 

p(0 > P(c n ) - J] p(c ; - cj) > 5/2. 

1=1 

We prove nC^' is not empty, which proves the claim. 
Choose w n in C". As 717^ (w„) is in the compact set E\ for all n, 
choose a subsequence 

... of 1, 2, . . . such that nj^w^iY)) 
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converges as k — > oo. But for finitely many n k s, ^r 2 (a>„ m (l)) is in 
the compact set E' 2 . As before choose a subsequence rf? of such 
that nT x ((o nk {2)) converges as k — > oo. By the diagonal process obtain a 
subsequence, w* of w„ such that TtT m {w* n ) converges as n — > oo for all m. 
Thus, if ? is in 

oo 

I lA m , then limit w* (?) = 

v> n— >oo 
m=l 

oo oo 

exists. Define w by w(0 = if t e A 1J A m , w(t) = x t if t e 1J A m . One 

m=l m=l 

oo 

easily sees that we f} C„, completing the proof of the theorem. 

n=l 

283 Martingales. 

Definition. Let (O, P) be a probability space, (T, <) a totally ordered 
set. Let (& t )teT be an increasing family of sub-cr-algebras of A 
collection (X t ) K j of random variables on Q. is called a martingale with 
respect to the family (^ t )teT if 

(i) E(\X t \) < oo, W e T; 

(ii) X, is ^-measurable for each t eT\ 

(iii) £(X f |.^s) = X s a.s. for each s, t in T with f > s. (Markov prop- 
erty). 

If instead of (iii) one has 

(iii)' E(X,\& S ) > (<)X S a.s., 

then (X t ) K T is called a submartingale (respectively supermartin- 
gale). 

From the definition it is clear that (X t ) t€ T is a submartingale if 
and only if (-X t ) te T is a supermartingale, hence it is sufficient to 
study the properties of only one of these. T is usually any one of 
the following sets 

[0,oo),tf,Z,{l,2,...,n},[0,oo] or AfU{oo}. 
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Examples. (1) Let {X n ) n= i^... be a sequence of independent random 
variables with 



Then Y n = X\ + • • • +X n is a martingale with respect to {^ n )n=\X- 284 
where 



& n = <r{Y 1 ,...,Y n } = <r{X 1 ,...,X n }. 
Proof. By definition, each Y n is ^-measurable. 
E(Y n ) = 0. 

E{{X X + • • • + X n + X n+1 + ■ ■ ■ + X n+m )\o-{X u X n }) 
= X l + ---+X n + E((X n+1 +■■■+ X n+m )\o-{X u X n }) 



(2) Let (O, P) be a probability space, Y a random variable with 
£■(171) < oo. Let & t c & be a cr-algebra such that W e [0, oo) 

& t c ^ if ? < s. 

If X; - E(Y\^ t ), X t is a martingale with respect to (J^ f ). 
Proo/ (i) By definition, X ? is ^-measurable. 

(ii) E(X t ) = E(Y) (by definition) < oo. 

(iii) if t > s, 



Exercise 1. Q = [0, 1], & = cr-algebra of all Borel sub sets of Q,, P = 
Lebesgue measure. 

Let =-algebra generated by the sets 



E(X n ) = 0. 



— Y n + E(X n+ i + • • • + X n+m ) — Y n . 



□ 



E(X t \& s ) = E(E(Y\& t )\& s ) = E(Y\& S ) = X s 



□ 
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Let/eL'[0, 1] and define 

X n (w) = 2 n 



( 2 n_ X j/2" 



J' 1 7-1/2" 2" -1/2" ) 



Show that (X n ) is a martingale relative to (^ n ). 

Exercise. Show that a submartingale or a supermartingale {X s } is a mar- 
tingale iff" E(X S ) = constant. 

Theorem . If{X t ) te j, (Y t ) te r are supermartingales then 

(i) (aX t + bY t ) t€ T is a supermartingale, Va, b e R + = [0, oo). 

( ii) (X t A Y t ) te j is a supermartingale. 

Proof. (i) Clearly Z t = aX t + bY t is ^-measurable and E(\Z t \) < 
aE(\X t \) + bE(\Y t \)<oo. 

E{aX t + bY t \& s ) = aE{X t \& s ) + bE{Y t \& s ) 

< aX s + bY s = Z s , if t > s. 

(ii) Again X t A Y t is ^-measurable and E(\X t A Y t \) < oo, 
E(X t A Y t \& s ) < E{X t \& s ) < X s . 

Similarly 

E(X t AY t \^ s )<E(Y t \^ s )<Y s , if t>s. 

Therefore 

E{X t A Y,\& s ) < X s A Y s . 

□ 

Jensen's Inequality. Let X be a random variable in (O, SS, P) with 
E(\X\) < oo and let <p(x) be a convex function defined on the real line 
such that £"(100X1) < oo. Then 

<p{E{X\^)) < E{<poX\tf) a.e. 

where ^ is any sub-cr-algebra of 38. 
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Proof. The function (f> being convex, there exist sequences a\, ai, . . . a n , 
...,b\,bi,...of real numbers such that <p(x) - sup(a n x + b n ) for each x. 

n 

Let L n (x) = a n x + b n . Then 

L n {E{Xm) = E(L n (X)\tf) < E(<f,(X)\tf) 

for all n so that 

<KE(X\tf)) < E(cf>(XW). 

□ 

Exercise, (a) If {X t : t e T\ is a martingale with respect to : t e 
T) and is a convex function on the real line such that E(\(f>(X t )\) < 
oo for every t, then {(f>(X t )} is a sub martingale. 

(b) If {X t ) te j is a submartingale and 0(x) is a convex function and 
nondecreasing and if E(\<f>QX t \) < oo, V? then is a sub- 

martingale. (Hint: Use Jensen's inequality). 

Definition. Let (Q., SB, P) be a probability space and (^ t )te[0,oo) an in- 287 
creasing family of sub-cr-algebras of Let (X ? ), g [o ;0 o) be a family of 
random variables on Q such that X, is ^-measurable for each t > 0. 
(X t ) is said to be progressively measurable if 

X : [0, t] x Q -> R defined by w) = X s (w) 

is measurable with respect to the tr-algebra t] x & t for every t. 

Stopping times. Let us suppose we are playing a game of chance, say, 
tossing a coin. The two possible outcomes of a toss are H (Heads) and 
T (Tails). We assume that the coin is unbiased so that the probability 
of getting a head is the same as the probability of getting a tail. Further 
suppose that we gain +1 for every head and lose 1 for every tail. A game 
of chance of this sort has the following features. 

1 . A person starts playing with an initial amount ,/V and finishes with 
a certain amount M. 
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2. Certain rules are specified which allow one to decide when to stop 
playing the game. For example, a person may not have sufficient 
money to play all the games, in which case he may decide to play 
only a certain number of games. 

It is obvious that such a game of chance is fair in that it is neither ad- 

288 vantageous nor disadvantageous to play such a game and on the average 
M will equal N, the initial amount. Furthermore, the stopping rules that 
are permissible have to be reasonable. The following type of stopping 
rule is obviously unreasonable. 

Rule. If the first toss is a tail the person quits at time and if the first 
toss is a head the person quits at time t = 1 . 

This rule is unreasonable because the decision to quit is made on 
the basis of a future event, whereas if the game is fair this decision 
should depend only on the events that have already occured. Suppose, 
for example, 10 games are played, then the quitting times can be 0, 
1, 2, . . . , 10. If ft, ... , fto are the outcomes (ft = +1 for H, ft - -1 for 
T) then the quitting time at the 5th stage (say) should depend only on 
ft, . . . ,ft and not any of ft, . . . ,ft . If we denote £ = (ft, . . . ,ft ) and 
the quitting time t as a function of £ then we can say that {<f : t = 5 
depends only ft, . . . , ft}. This leads us to the notion of stopping times. 

Definition. Let (Q, P) be a probability space, (<^ t )te[0,co) an increas- 
ing family of sub-cr-algebras of r : Q — > [0, oo] is called a stopping 
time or Markov time (or a random variable independent of the future) if 

{w : t(w) <t\ € & t for each t > 0. 

Observe that a stopping time is a measurable function with respect 
to cr(U^) C 

289 Examples. 1. t = constant is a stopping time. 

2. For a Brownian motion (X t ), the hitting time of a closed set is 
stopping time. 

Exercise 2. Let & t+ = f| & s = & t . 

Def s>t 
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[If this is satisfied for every t > 0, & t is said to be right continuous]. If 
{r < t) € & t for each t > 0, then t is a stopping time. (Hint: {r < t = 

CO 

(~){t < t + \/n] for every k). 

n=k 

We shall denote by the cr-algebra generated by [J If t is a 

teT 

stopping time, we define 

& T = {A e : A n {t < t\ € V* > 0} 
Exercise 3. (a) Show that ^ T is a cr-algebra. (If A € J*" T , 
A''n(i<(h|'<(|-An(r< t}). 

(b) If r = t (constant) show that & T = & t . 
Theorem . Let r awo* cr Z?e stopping times. Then 

(i) t + cr, tvo", r A <x are aZZ stopping times. 

(ii) Ifo-<T, then & a c 

(iii) r w ^T-measurable. 

(iv) 7/" A e ^o-, ?/iera A n (o- = r| arad A n {cr < t} are Zn ^o- A r c 

^o- fl In particular, {r < cr), {r = cr), {t > cr) are aZZ in 290 

(v) If t' is ,^ T -measurable and r' > r, ?/ie« r' Zj a stopping time. 

(vi) /Hr,,} Zs a sequence of stopping times, thenhmT n . limr,, are aZso 
stopping times provided that = Wt > 0. 

oo 

(vii) /jf r ra J, r, Z/ien <F T = f| ^t„ provided that & t+ = & t , W > 0. 

n=l 

Proo/ (i) 

{cr + r) > = {cr + t > f, T < t, cr < t) U |r > U {cr > t\; 

{cr + T>t,Cr<t}=T<£/ 
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= {cr > r > t - t, t < t, cr < t\ 

0<r<t 

(J2 - set of rationals) 
{cr > r > t - t,t < t,cr < t\ - {t > cr > r) n {t > t > t - r\ 
= {cr < t) n {cr < r) c n {t < t) n {r < t - rf . 

The right side is in ,^ t . Therefore cr + t is a scopping time. 
{tVct < t) = {t < t) n {cr < t) 
{T A cr > t} = {T> t\r\{cr> t\ 

(ii) Follows from (iv). 

(iii) {t < t\{T <jh|T<(As|e 3? tAs c & s , Vs > 0. 

(iv) A n {cr < t} n {cr A r < t\ - [A n {cr < t < t\] 
U[A n U {cr << t) n {t < t}] € & t . 

0<r<t 

291 A n {cr < t} n {cr A t < t) = A n {cr < t) n {cr < t). 

It is now enough to show that (cr < r) e #o-; but this is obvious 
because (t < cr) = (cr < r) c is in ^o- A r c Therefore A n {cr < 
t} e #o-at and (iv) is proved. 

(v) {t' <t} = {t' <t}n{r <t) e & t as (t' <«)e Therefore t' is 
a stopping time. 

(vi) lim t„ = sup inf tj. 

„ fen 

= supinfinf{T„,T„ + i,...,T n+ ^}. 

n ' 

By (i), inf{T„,T„ + i, . . . ,r n+ e) is a stopping time. Thus we have 
only to prove that if r„ t t or r„ J, t where t„ are stopping times, 

oo 

then r is a stopping time. Let t„ t t. Then {t < t] = (~) {r n < t] 

n=\ 

so that t is a stopping time. Let t„ J, t. Then 

oo 

{r > = P(r„ > t). 

n=l 
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By Exercise 3, t is a stopping time. That limr„ is a stopping time 
is proved similarly. 

CO DO 

(vii) Since t < t„, Vn, & T c f| J*" T „. Let A e f| J*" T „. Therefore 

CO 

A n (t„ < t) e J^, V«. A n (t < - H n (r m < t)) e & t . 

m=l 

Therefore A e J^" T . 

□ 

Optional Sampling Theorem. (Discrete case). Let \X\, . . . ,Xu) be a 
martingale relative to {#i, . . . , J^*}. Let [r\, . . . ,T p \ be a collection of 
stopping times relative to \&\, . . . , such that T\ < T2 < . . ■ < t p 292 
a.s. and each t; takes values in {1, 2, . . . , k\. Then {X Tl , . . . ,X Tp \ is a 
martingale relative to {& Tl ,...,<& T } where for any stopping time r, 
X T (io) = X T{w) {a)). 

Proof. It is easy to see that each X Tj is a random variable. In fact X Tm - 

k 

2 XiX{ Tm =i). Let r e {1,2, . . . , k}. Then 



(=1 



k 

e(\x t \) < y i \xj\dp < co. 



< 2 r i^i, 



Consider 

(X Tj <t)n ( Tj <s) = f](Xt <t)e & s . 
Then (X Tj < t) is in ^ Tp i.e. X Tj is & T . -measurable. Next we show 

that 

(*) E{X Tj \P Tk ) <X Tk , if j>k. 

(*) is true if and only if 

Jx Tj dP< Jx Tk dP for every Ae^ t . 

A A 

The theorem is therefore a consequence of the following □ 
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Lemma . Let [X\, . . . , X^} be a supermartingale relative to 

If t and cr are stopping times relative to {#1, . . . , J^*} taking values in 
{ 1 , 2, . . . , k) such that t < cr then 

J X T dP> J X a dP for every A e 

A A 

293 Proof. Assume first that cr - t < 1 . Then 

J (X T - X a )dP = £ J (X T - X a )dP 

A j =1 [An(T=j)n(T«r)] 

j =1 [An(r=j)] 

A e Therefore A n (t = j) € By supermartingale property 

J (Xj-X j+l )dP>0. 



[An(r=y)] 

Therefore 

J (X T - X^dP > 0. 

A 

Consider now the general case t < cr. Define t„ = cr A (t + «). 
Therefore t„ > t. t„ is a stopping time taking values in {1, 2, . . . , k}, 

T n +l>T n , T„+1-T„<1, T k = CT. 

Therefore J X Tn dP > J X Tn+l dP, VA € 3? Tn . If A € J*" T then A e 

A A 

#V n , Vra. Therefore 

J X Tl dP > J X T2 dP >...> J X Tk dP, VA e ,^ T . 
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Now ti - t < 1 . t < ti . Therefore 



J X T dP> J X Tl dP> J Xa-dP. 



A A 

This completes the proof. □ 
N.B. The equality in (*) follows by applying the argument to 

{-X\, . . ., -X k ). 

Corollary 1. Let {X\,X2, . . ■ ,X k ) be a super-martingale relative to 

Ifr is any stopping time, then 

E(X k ) < E(X T ) < E{X X ). 

Proof. Follows from the fact that {X\,X T ,X k } is a supermartingale rela- 
tiveto {^i,^ T ,^ k }. □ 

Corollary 2. If[X\,X2, ■ ■ ■ ,X k } is a super-martingale relative to 

and t is any stopping time, then 

E(X T ) < E(\X!\) + 2E{X~ k ) < 3 sup E(\X n \) 

\<n<k 

where for any real x, x~ = — . 



Proof X- = *' \ so 2E{X- k ) = E(\X k \) - E(X k ). 



\x k \-_x k 

2 

By theorem {X T A0, X k AO} is a super-martingale relative to {^ T , J? k }. 
Therefore E(X k A 0|#V) < E(X T A 0). Hence 



E(\X T \) - E(X T ) 
E{X~ k ) > E{X~ T ) = rU 
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Therefore 

E(\X T \) < 2E(X~ k ) + E(X T ) 

< 2E(X' k ) + E{X X ) < 3 sup E{\X n \). 

\<n<k 

□ 

Theorem . Let (Q, & ', P) be a probability space and (^t)t>o on increas- 
295 ing family of sub-cr-algebras of Let r be a finite stopping time, and 
(X t ) t >Q a progressively measurable family (i.e. X : [0, oo) x Q. — > R 
defined by X(t, w) = X t (w) is progressively measurable). If X T (w) = 
X T ( W )(w), then X T is ^-measurable. 

Proof. We show that {w : X(t(w), w) < t, t(w) < s] e ^ t for every t. 
Let Q s - {w : r(w) < s}\ Q s e & s and hence the cr-algebra induced by 
& s on Q s is precisely 

[A n : A e J^} - {A € J?, : A c QJ. 

Since t(w) is measurable, 

w — > (t(w), w) of Q. s — > [0, s] X Q x 

is (^j, s] x ^" s )-measurable. Since X is progressively measurable, 

[0, s] x Q v — > R is measurable. 

Therefore {w : X(t(w), w) < t, t(w) < s] e tr-algebra on Q s . There- 
fore X T is & T measurable. 

The next theorem gives a condition under which (X t ) t >Q is progres- 
sively measurable. □ 

Theorem . IfX t is right continuous in t, Vw and X t is ^-measurable, 
Vf > then (X t ) t >o is progressively measurable. 

Proof. Define 

X n (t,w) = X\ , w J, f. 

\ « ) n 
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Then 

Lt X n (t, w) - X(t, w) (by right continuity) 

n— >co 

Step 1. Suppose T is rational, T = m/n where m > is an integer. Then 
{(t,w) :0<t<T, X n (t,w) < a] 
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0</<m-l 

Thus if T = m/n, X n \[oj) X n is ^[0, T] x ^-measurable. Now 
r = - — . Letting £ — > oo, by right continuity of X(t) one gets X|[o,)xn is 

KYI 

[0, T] x ^--measurable. As X(T) is ^-measurable, one gets X|[o,r]xn 
is [0, T] X .^j -measurable. 

Step 2. Let T be irrational. Choose a sequence of rationals S „ increasing 
to T. 

{(t,w) :0<t<T, X(t,w) < a) 

CO 

- |J{(f,w) - 0<t< S n ,X(t,w) <a\U {T\xXj\-oo, a ] 

n=\ 

The countable union is in T]xJ^t by Step 1. The second mem- 
ber is also in T] x &j as X(T) is &j -measurable. Thus X|[o,r]xn 
is &[o,T] x &j -measurable when T is irrational also. 



Remark. The technique used above is similar to the one used for prov- 
ing that a right continuous function / : R — > R is Borel measurable. 

Theorem . Let {X\ , X^} be a supermartingale and A > 0. Then 297 

(1) AP{ sup X n > A) < E(X{) - J X k dP 

I \<n<k I 

< E(X{) + E(X7). 
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(2) AP( inf X n < -A) < - J X k dP 

l - n ~ k (infZ„<-/l) 

< E{X~ k ). 



Proof. Define 

t(w) = inf{« : X n > A] if supX n > A, 
- k, if sup X n < A. 

n 

Clearly t > and t is a stopping time. If r < k, then X T (w) > A for 
each w. 

E(X T )= J X T dP+ J X T dP 

(supX„>/l) (swpX„<A) 

> AP(supX n > A) + J X k dP. 

(supX n <A) 

Therefore 

E{X l )>AP{supX n >A)+ J X k dP, 

(supX„<i) 

AP(sup X n >A)< EiXO - J X k dP < E{X X ) + E(X~ k ) 

(supX„<i) 

The proof of (2) is similar if we define 



r(w) = 



|inf{« : X n < -A], if MX n < -A, 
I k, if inf X n > -A. 



298 Kolmogorov's Inequality (Discrete Case). Let {X\, . . . ,X k ) be a finite 
sequence of independent random variables with mean 0. Then 

p( sup (\X X +...+X n \>A)< ^E((X X +X 2 + ---+ X k ) 2 )) 

\l<n<k A J 
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Proof. If S n - X\ + • • • + X n , n - 1,2, ...,k, then [Si,..., St) is a 
martingale with respect to [&\, where & n = cr[X\, . . . ,X n }. 

Therefore S 2 ,...,Sf is a submartingale (since x — > x 2 is convex). By 
the previous theorem, 

A 2 P[M-Sl<-A 2 )<E((-S 2 K y) 

Therefore 

E((-S 2 k T) E(S 2 ) 



P[sup\S n \ >A\< 



A 2 A 2 



= ^E((Xi +X 2 + ---+X k ) 2 ). 



Kolmogorov's Inequality (Continuous case). Let [X(t) : t > 0} be a 
continuous martingale with E(X(0)) = 0. If < T < oo, then for any 

P[w : sup \X(s,w)\ >e)< ^-E((X(T)) 2 ). 

1 o<.v<r ' 

Proof. For any positive integer k define Yq = X(0), 

Yi=x(Ly X( 0),Y 2 =x{pl-xQ,..., Y2k 

-_ x ( 2 Z\-x{V k ~ l) ' 



2 k ) \ 2 k 

By Kolmogorov inequality for the discrete case, for any 5 > 0. 
sup \x(^-)\>s)<^E((X(T)) 2 ). 



By continuity of X(t), Au - [w : sup l^(-r-)l > 5} increases to 299 

0<n<2« V2 I 

{ sup \X(s)\ > 5} so that one gets 

0<.v<T 

(1) p( sup \X(s)\ >6\< ^E((X(T)) 2 ). 

\0<s<T ) O 
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Now 



P\ sup \X{s)\ > e ) < limit/ 5 ) SU P \ x ( s )\ >e-—\ 
\o<s<t I m ^°° \o<i<r m) 



l—E((X(T)) 2 ), by(l). 

(e - 1 /my 



= He 2 E{{X{T)f). 



This completes the proof. 



□ 



Optional Sampling Theorem (Countable case). Let {X n : n > 1} be 

a supermartingale relative to : n > 1}. Assume that for some 
Xoo e L , X n > E{X (XS \,^ n ). Let cr, r be stopping times taking values in 
N U {oo}, with cr < t. Define X T = X^ on {cr = oo} and X T = X m on 
[o- = oo}. Then E{X T \& a ) < X a . 

Proof. We prove the theorem in three steps. 

Step 1. Let = so that X n > 0. Let tu - r A k, o> = t A k. By 
optional sampling theorem for discrete case E(X Tk ) < E{Xu) < E{X\). 
By Fatou's lemma, E(X T ) < oo. Again by optional sampling theorem 
for the discrete case, 



E(^l^)a ffl ...,(0). 

Let A e Jv Then AC\{cr<k}e J^, and by (0) 




Art{T<k) 



An(r<k) 



An(cr<k) 



An(cr<k) 



Letting k — > oo, 



(1) 




An(r?too) 



An(o-^oo) 



Clearly 



(2) 



An(r=oo) 
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By (1) and (2), MX dP < f X a dP, proving that 

A A 

E{X T \^ a ) < X a . 

Step 2. Suppose X n - E{Xoo\^ n ). In this case we show that X T = 
EiXcl&r) for every stopping time so that E(X T \& a ) = X a . If A € & T , 
then 

J X T dP = J XoedP for every k. 

(j<k) AC\(t<K) 



Letting k — > oo, 



(1) 

An(T^Oo) An(T5too) 

(2) J X^/ 5 - J XoedP = J X^/ 5 

An(r=oo) A An(r=oo) 

The assertion follows from (1) and (2). 
Step 3. Let X n be general. Then 

X n = X n - EiX^n) + E(X M \& n ). 
Apply Step (1) to Y n = X n - EiX^n) and Step (2) to 

Z n — E(X 0O \.^ n ) 

to complete the proof. 



Uniform Integrability. 

Definition. Let (£l,38,P) be any probability space, L 1 - l}(Q.,38,P). 
A family H c L 1 is called uniformly integrable if for every e > there 
exists a J > such that j \X\dP < e for all X in //. 

(M><5) 
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Note. Every uniformly integrable family is a bounded family. 

Proposition . Let X n be a sequence in L l and let X n — > X a.e. Then 
X n — > X in L l iff{X n : n > 1} is uniformly integrable. 

Proof, is left as an exercise. □ 

As {X n : n > 1} is a bounded family, by Fatou's lemma X e L l . 
Let e > be given. By Egoroff 's theorem there exists a set F such that 
P(F) < e and X n — > X uniformly on F. 

J \X n - X\dP < \\X n - X|U >n _ F+ J \X n - X\dP 

F 

< \\X n - XW^n-F + J \X n \dP + J \X\dP 

F F 
<\\X n -X\\ 0o ^-F+ J \X„\dP+ J \X\dP+ 



Fn(\X n \>6) FnQX\>6) 

+ 

Fn{|X„|<<5) Fn(|X|<<5) 



J \X n \dP+ J XdP 

l\X n \<6} FH(\X\<6) 

<\\X„-X\\ 00<[1 -f + J \X n \dP+ J \X\dP + 28e 

(\X n \>6) (\X\>6) 

The result follows by uniform integrability of {X,X n : n > 1}. 

Corollary . Let ^€ be any sub-cr-algebra of S3. IfX n — > X a.e. andX n is 
uniformly integrable, then E(X n \ < ta) —> E(X\ ( tf) in L l (Q., % ', P). 

Proposition . Let H c L . Suppose there exists an increasing convex 
function G : [0, oo) — > [0, oo) such that 

G(t) 

limit - oo and sup E(G(\X\)) < oo. 

Then the family H is uniformly integrable. 
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Example . G(t) = t 2 is a function satisfying the conditions of the theo- 
rem. 

Proof, (of the proposition). Let 

M = sup E(G(\X\)). 

XeH 

Let e > be given. Choose 6 > such that 

> — for t > 8. 

t e 

Then for X in H 

J \X\dP < ^ J G(\X\)dP < ^ J G(\X\)dP < £ 

(|X|>5) (|X|>,5) G 

□ 

Remark. The converse of the theorem is also true. 

Exercise. Let H be a bounded set in L°°, i.e. there exists a constant M 
such that \\XWco < M for all X in H. Then H is uniformly integrable. 

Up Crossings and Down Crossings. 

Definition. Let a < b be real numbers; let si, S2, ■ ■ ■ , Sk be also given 
reals. Define ii, ?2, . . . , 4 as follows. 



h = 



12 = 



13 = 



|inf{« : s n < a}, 
\k, if no si < a; 

[inf{« > i\ : s n > b\, 

\k, if s n < b for each n> i\\ 

|inf{« > ?2 : Sn < a], 

\k, if s n > a for each n > ii\ 



and so on 



308 



33. Application of Stochastic Integral 



Let t\ - s h , t 2 = s h ,.... If (h,t 2 ), fau),..., (t2 P -\,t2p) are the 
only non-empty intervals and fep+i>^2p+2)> ... are all empty, then p is 
called the ******** of the sequence s\, . . . , Sk for the interval [a, b] and 
is denoted by U(si, . . . , s^, [a, b]). 

Note. U (the up crossing) always takes values in {0, 1, 2, 3, . . .}. 

Definition. For any subset S of reals define 

U(S; [a,b]) - sup{U(F; [a,b]) : F is a finite subset of S} 

The number of down crossings is defined by 

D(S;[a,b]) = U(-S;[-b,-a]). 

For any real valued function / on any set S we define 

U(f,S,[a,b]) = U(f(S),[a,b]). 

If the domain of S is known, we usually suppress it. 

304 Proposition . Let a\,ai,... be any sequence of real numbers and S = 
{a\,ci2, ■ ■ ■}. If U(S, [a, b]) < oo for all a < b, then these sequence {a n } 
is a convergent sequence. 

Proof. It is clear that if T c S then U(T,[a,b]) < U(S,[a,b]). If 
the sequence were not convergent, then we can find a and b such that 
liminf a n < a < b < limsup^n. Choose n\ < n 2 < n$ . . .; m\ < m 2 < 
. . . such that a„ t < a and a mj > b for all i. If T = {a ni , a m , a n2 ,a m2 , . . .}, 
then U(S ; [a, b]) > U(T; [a, b]) = oo; a contradiction. □ 

Remark. The converse of the proposition is also true. 

Theorem . (Doob's inequalities for up crossings and down crossings). 
Let {X\, . . . ,Xk\ be a submartingale relative to {^\, . . . , J^t) a < b. 
Define U(w, [a,b]) = U(X\(w), . . . ,Xk(w); [a, b]) and similarly define 
D(w, [a, b]). Then 

(i) U, D are measurable functions; 



309 



(11) £(C/(-,[a,fe])) < - ; 

o - a 

(iii) £(£>(•, [a • b])) < E((X k - b) + )/(b - a). 

Proof. (i) is left as an exercise. 

(ii) Define Y n - (X n - a) + ; there are submartingales. Then clearly 
Y n < if and only if X n < a and Y n > b - a iff X„ > b, so that 

UYi(w), Y k {w); [0, b-a]) = U{X X { W ), X k (w); [a, b]) 



Define 

Tl - 1 

T2 - 



T3 



|inf{n : Y n = 0} 
I k, if each 7„ = 

|inf{« > T2 : Y n > b - a, 

| k, if F„ < b - a for each n > T2, 



T k+ \ = k. 

As [Yi, . . . , Y*;} is a submartingale, by optional sampling theorem 
F Tl , . . . , F Tt+1 is also a submartingale. Thus 

(1) z? (y T2 - y Ti ) + £(y T4 - y T3 ) + • • • > o. 

Clearly 

[(y T3 - y T2 ) + (Y T5 - y T4 ) + • • ■ > (& - a) u (y^w), . . . y^w); 

[0, b - a]) - (b - a) U (w, [a, £]). 

Therefore 

(2) £(y T3 - Y T2 ) + E(Y T5 - y T4 ) + • • • > (b - a)E(U(-, [a, b])). 
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By (1) and (2), 

E{Y k -Y x )>{b-a)E{U{;[aM)) 
giving the result, 
(iii) Let Y n = (X n - a) + so that 

DiYiiw), . . . Y k (w); [0,b- a]) = D(X x {w), . . .,X k (w); [a,b]) 

306 Define 



l; 




inf{« : Y n > b - a], 
k, if each Y n < b - a; 




M{n >t 2 :Y„ = 0}, 

k, if each Y n > for each n > t-i, 



k. 



By optional sampling theorem we get 



0>E(Y T2 -Y T3 ) + E{Y T4 -Y T5 ) + -- - . 



Therefore 



> (b - a)E(D(Y[ ,...,Y k ;[0,b- a])) + E{{b -a)- Y k ). 



Hence 



E(D(; [a, b])) < E{{X k - at - (b - a))/(b - a) 



< 



E{{X k - b) + ) 
(b-a) 
for all c. 



, for (c - a) + -(b-a)<(c- b) + 



□ 
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Corollary . Let [X\ , . . . , X k ] be a supermartingale. U, D as in theorem. 
Then 

(1) E(D(-, [a, b])) < 



(ii) E(U(; [a,b])) < 



b - a 
E((X k - by) 



b - a 

Proof. (i) E(D(-, [a, b])) = E{U{-X x {w), -X k (w), [-b, -a]) 

„ E((-x k + by - {-x x + b) + ) 



b - a 

E((b A X k ) - (b A Xi)) 



-, by above theorem, 



since for 



b - a 

since for all a, b, c, (b - c) + - (b - a) + < (b A a) - (b A c). 

(ii) E(U(-,[a,b])) = 

= (w), . . . , -X k (w); [-b, -a])) 

„ £((-X* + a) + ) 



b - a 
E((X k - b)~) 



-, by theorem, 



b - a 

(since (-X k + a) + < (X k - by, 

□ 

Theorem . Let {X n : n - 1, 2, . . .} be a supermartingale relative to {,^ n : 
n - 1, 2, . . .}. Le? (Q, J£~, P) fte complete. 

(i) 7/'sup£'(X~) < oo, f/ierc X„ converges a.e. to a random variable 

n 

denoted by Xa,. 

(ii) if {X n : n > \ \ is uniformly integrable, then also Xoo exists. Fur- 
ther, {X n : n = 1,2, ...,n = oo) is a supermartingale with the 
natural order. 

(iii) if {X n : n > 1} is a martingale, then {X n : n > l,n = oo) is a 
martingale. 
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Proof. (i) Let U(w[a, b]) = U{X x (w), X 2 (w), . . . , [a, b]). By the coro- 
llary to Doob's inequalities theorem, 

E(U(; [a, b]) < sup E((X n - by) < oo 

n 

308 for all a < b. Allowing a, b to vary over the rationals alone we 
find that the sequence X n is convergent a.e. 

(ii) SupE(X~) < supE(\X n \) < oo so that Xco exists. As X n — > Xoo in 

n n 

L 1 we get that {X n : n > \,n - oo} is a supermartingale. 

(iii) follows from (ii). 

□ 

Proposition . Let {X t : t > 0} be a supermartingale relative to : t > 
0}. / = [r, s], a < b and S any countable dense subset. Let U (w, S D 
/, [a, b]) = U(; {X t (w) : t e S n /}, [a, b]). Then 

unit c ^ i r z,\\ ^ £ (C^s ~ ^)~) 
E{U{-,S nl,[a,b)) < . 

b - a 

Proof. Let S n / be an increasing union of finite sets F n : then 

£(C/(-,F„,[a,fe])) < - < - . 

b - a b - a 

The result follows by Fatou's lemma. □ 

Exercise . If further X, is continuous i.e. t — > X t (w) is continuous for 
each w, then prove that 

E(U(; I, [a, b])) < 

b - a 

Theorem . Let (Q, & ', P) be complete and [X t : t > 0} a continuous 
supermartingale. 

309 (i) If sup E(X~) < oo, then X t converges a.e. to a random variable 

t>0 
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(ii) If [X t : t > 0} is uniformly integrable then also Xoo exists and 
{X t : t > 0,t = 00} is a supermartingale. 

Proof (i) E(U(; [0, n], [a, b])) < E((X n - b)~)/(b - a) so that 

E((X S - bT) 

limit E(U(; [0, n], [a, b])) < sup — V — 

n^oo Q < s b-a 

for all a < b. Thus [X t (w) : t > 0} converges a.e. whose limit in 
denoted by X^ which is measurable. 

(ii) As E(X~) < E(\X t \) by (i) X^ exists, the other assertion is a con- 
sequence of uniform integrability. 

□ 

Corollary . Let {X t : t > 0} be a continuous uniformly integrable mar- 
tingale. Then {X t : < t < 00} is also a martingale. 

Exercise. Let [X t : t > 0} be a continuous martingale such that for some 
Y with < Y < 1 E(Y\3? t ) = X t show that X t ^ Y a.e. 

Lemma . Let (Q, J 5 ", P) be a probability space, #1 D ^ ^"3 • • • be 
sub-cr-algebras. Let X\,X2, . . . be a real valued functions measurable 
with respect to #1, ... , & n , . . . respectively. Let 

(i) E(X n ^ n )<X n 

(ii) sup E(X n ) < 00. 

n 

Then {X n : n > I ) is uniformly integrable. 310 

Proof. By (i) E(X n ) is increasing. By (ii) given e > 0, we can find «o 
such that if n > no then E(X n ) < E(X nQ ) + e. For and 6 > 0, 



J \X„ 

U><5) 

= E{X n )+ J -X n dP- J X n 



n>n J \X n \dP 

(\X„\>6) 

JP 

(X„<-6) (X n <S) 
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< J -X no dP- J X no dP + E(X n ) by(i) 

(X„<-6) (X„<6) 

<e+ J X no dP - J X no dP (because E(X n ) < E{X no ) + e) 

(X n >5) (Xn<-5) 

<e+ J \X no \dP 

(\X„\>S) 

Thus to show uniform integrability we have only to show P(\X n \ > 
6) — > uniformly in n as 8 — > <x>. Now 

E(\X n \) = E(X n + 2X~) 

<E{X n ) + 2E{\X x \) by(i) 
< M < oo for all n by (ii) 

The result follows as P(\X n \ > 5) < M/6. □ 

Optional Sampling Theorem. (Continuous case). 

Let {X t : t > 0} be a right continuous supermartingale relative to 
{^t '■ t > 0}. Assume there exists an Xoo e L'(Q.,JP,P) such that X t > 
311 E{X xs \,^ t ) for t > 0. For any stopping time t taking values in [0, oo], let 
X T - Xoo on {t - oo}. Then 

(i) X T is integrable. 

(ii) If cr <t are stopping times, then 

E{X T \& a ) < X a . 

Proof. Define 

_ [2V] + 1 _ [2 n cr] + 1 

°~ n ~ jj 1 ' Tn ~ 2 n ' 
Then cr n , T n are stopping times, a„ < r„, a < cr n , r < t„. cr n , 
T n take values in D n - {oo, 0, 1 /2 n , 2/2", . . . , 1 /2'\ . . .} so that we have 
E{X Tn \^ an ) < X an . Thus if, Ae^c\, then 



(*) J X Tn dP < J X an dP 
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As <r\ > o"2 > . . ., by optional sampling theorem for the countable 
case, we have 

Further 

By the lemma {X^J, {X T J are uniformly integrable families. By 
right continuity X a - n — > X a pointwise and X Tn — > X T pointwise. Letting 
n — > oo in (*) we get the required result. □ 

Lemma (Integration by Parts). Let M(t, •) be a continuous progres- 312 
sively measurable martingale and A(t, w) : [0, oo) x Q — > R. &e o/ 
bounded variation for each w. Further, assume thatA(t, w) is ^-measu- 
rable for each t. Then 



t 

Y(u-) = M(t.-)A(t.-) = J M(s,-klA(s,-) 

o 

is a martingale if 



T 

t,-)A{t,-) = J j 



£(sup \M(s,-)\\\A(-)\\ t )<oo 

0<s<t 

for each t, where ||A(w)|| ? is the total variation of A(s, w) in [0, t]. 
Proof. By hypothesis, 

n 

^M(v)(%i,.)-A( Si ,-)) 

i=0 

converges to 



M(u, -)dA(u, •) in L 1 as n — > oo 



and as the norm of the partition s = sq < s\ < . . . < s n+ i - t converges 
to zero. Hence it is enough to show that 

n 

E([M(t, -)A(t, •) - £ M(s i+1 ,-)(A(s i+1 ,-) - A(s h -))W.s) 
(=0 
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= M(s, -)A(s, •). 
But the left side = E{M{s n+l , -)A{s n+l , ■)- 

n 

- £ M(s i+1 ,-)(A(s i+u -) - A(s h 

i=0 

= M(s, -)A(s, •). 
Taking limits as n — > oo and observing that 



we get 



sup |0, + i - si)\ -> 0, 

()<!<« 



E(M(t, -)A(t, •)- J M(u,-)dA(u,-)\^s) 
o 



- M(s, -)A(s, •) - 
o 



J M(u,-)dA(u,- 
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